-- Logs begin at Sun 2022-10-09 00:10:45 UTC, end at Sun 2022-10-09 01:15:45 UTC. -- Oct 09 00:47:32.333011 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@q-agt.service. Oct 09 00:47:34.867859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.common.config [-] Logging enabled! Oct 09 00:47:34.868514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.common.config [-] /usr/local/bin/neutron-openvswitch-agent version 21.1.0.dev54 Oct 09 00:47:34.868762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=107274) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} Oct 09 00:47:34.869182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO os_ken.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp Oct 09 00:47:35.356853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO keyring.backend [-] Loading KWallet Oct 09 00:47:35.364428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO keyring.backend [-] Loading SecretService Oct 09 00:47:35.368030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO keyring.backend [-] Loading Windows Oct 09 00:47:35.369359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO keyring.backend [-] Loading chainer Oct 09 00:47:35.370133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO keyring.backend [-] Loading macOS Oct 09 00:47:35.975861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:35.976469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:35.976469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:35.977667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:35.977934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:35.978193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.034891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.035169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.035433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.056145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.056145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.056145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.068446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.068914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.069328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.107383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.107939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.108207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.283059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Oct 09 00:47:36.284417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO os_ken.base.app_manager [-] loading app os_ken.app.ofctl.service Oct 09 00:47:36.285679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Oct 09 00:47:36.286346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO os_ken.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp of OVSNeutronAgentOSKenApp Oct 09 00:47:36.286974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO os_ken.base.app_manager [-] instantiating app os_ken.controller.ofp_handler of OFPHandler Oct 09 00:47:36.287559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO os_ken.base.app_manager [-] instantiating app os_ken.app.ofctl.service of OfctlService Oct 09 00:47:36.288991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: Open vSwitch agent after_init 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:36.291650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.agent_extensions_manager [-] Loaded agent extensions: [] Oct 09 00:47:36.292109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 09 00:47:36.292491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Configuration options gathered from: {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 09 00:47:36.292873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 09 00:47:36.293321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 09 00:47:36.293675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ================================================================================ {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 09 00:47:36.294174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent_down_time = 75 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.294610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] allow_bulk = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.295111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_extensions_path = {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.295548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_paste_config = api-paste.ini {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.296053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] auth_strategy = keystone {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.296484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] backlog = 4096 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.296906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.297370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_host = 0.0.0.0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.297785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_port = 9696 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.298205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] client_socket_timeout = 900 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.298618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_dir = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.298990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.299399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_source = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.299873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] control_exchange = neutron {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.300344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] core_plugin = ml2 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.300871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] debug = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.301304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_availability_zones = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.301996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.302435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_agent_notification = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.303107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_lease_duration = 86400 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.303716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_load_type = networks {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.304352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dns_domain = openstacklocal {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.305038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_new_agents = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.305614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_traditional_dhcp = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.306472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] external_dns_driver = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.307067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] filter_validation = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.307678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] global_physnet_mtu = 1500 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.308408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] host = dv-cinder-master-3-iscsi {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.308947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] http_retries = 3 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.309395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_format = [instance: %(uuid)s] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.309856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.310339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipam_driver = internal {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.310758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipv6_pd_enabled = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.311243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_config_append = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.311707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.312114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_dir = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.312519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_file = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.313770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval = 1 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.314215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval_type = days {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.314701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotation_type = none {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.315214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.315586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.315967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.316409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.317071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.317479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_dns_nameservers = 5 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.317884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_header_line = 16384 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.318287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_count = 30 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.318704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_size_mb = 200 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.319107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_subnet_host_routes = 20 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.319505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] network_link_prefix = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.319942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_data_changes = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.320372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_status_changes = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.320826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] pagination_max_limit = -1 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.321327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] publish_errors = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.321785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_burst = 0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.322202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_except_level = CRITICAL {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.322604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_interval = 0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.323007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] retry_until_window = 30 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.323422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_resources_processing_step = 20 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.323863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_response_max_timeout = 600 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.324267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] send_events_interval = 2 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.324698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.325204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] setproctitle = on {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.325621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] state_path = /opt/stack/data/neutron {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.326060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] syslog_log_facility = LOG_USER {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.326466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] tcp_keepidle = 600 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.326883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] transport_url = **** {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.327295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_eventlog = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.327724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_journal = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.328155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_json = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.329163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_ssl = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.329581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_stderr = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.329995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_syslog = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.330398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] vlan_transparent = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.330843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] watch_log_file = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.331354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_default_pool_size = 100 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.331781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_keep_alive = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.332233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.332649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_server_debug = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:47:36.333086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.333515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.334086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.connection_string = messaging:// {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.334523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.enabled = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.334945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_doc_type = notification {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.335456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_size = 10000 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.335907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_time = 2m {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.336317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.filter_error_trace = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.336755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.hmac_keys = SECRET_KEY {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.337176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.sentinel_service_name = mymaster {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.337601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.socket_timeout = 0.1 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.338009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.trace_sqlalchemy = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.338439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_new_defaults = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.338943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_scope = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.339369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_default_rule = default {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.339836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.340280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.340754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.341164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.341665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.342074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.342485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.342902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.343311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.343820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.344278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.344706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.345136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.345841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.arp_responder = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.346257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.baremetal_smartnic = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.346945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dont_fragment = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.347378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.drop_flows_on_start = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.347808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.348221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp_inherit = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.348631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.enable_distributed_routing = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.349058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.explicitly_egress_direct = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.349478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.l2_population = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.349886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.log_agent_heartbeats = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.350295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.minimize_polling = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.351849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.ovsdb_monitor_respawn_interval = 30 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.352276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.polling_interval = 2 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.352697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.quitting_rpc_timeout = 10 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.353137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.report_interval = 30.0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.353567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.353995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.354409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_csum = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.354847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_types = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.355273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.355809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.veth_mtu = 9000 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.356227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.vxlan_udp_port = 4789 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.356673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.357107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mappings = ['physnet1:br-data'] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.357543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.datapath_type = system {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.357966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.igmp_snooping_enable = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.358385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.358815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.integration_bridge = br-int {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.359234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.local_ip = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.360192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_connect_timeout = 300 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.360640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_inactivity_probe = 10 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.361084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.361493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_port = 6633 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.362027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_request_timeout = 300 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.362446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.openflow_processed_per_port = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.362867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.363289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_debug = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.363716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_timeout = 10 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.364134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.364539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.364957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.365430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.365979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.366399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.366815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.367223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_ca_cert_file = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.367700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_cert_file = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.368137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_key_file = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.368569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.368992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tunnel_bridge = br-tun {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.369415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.369831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_rebinding_time = 0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.370253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_renewal_time = 0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.370672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.enable_ipv6 = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.371085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] LOCAL_IP.static_nat = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.371501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_section = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.372090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_type = password {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.372533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.372938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.certfile = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.373359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.collect_timing = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.373786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.endpoint_type = public {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.374204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.insecure = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.374606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.keyfile = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.375039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.region_name = RegionOne {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.376126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.split_loggers = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.376951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.timeout = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.377405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_section = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.377838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_type = password {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.378278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.378691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.certfile = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.379103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.collect_timing = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.379537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.endpoint_type = public {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.390372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.insecure = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.391145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.keyfile = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.391617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.region_name = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.392067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.split_loggers = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.392514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.timeout = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.392944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_section = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.393366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_type = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.393795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.cafile = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.394206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.certfile = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.394623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.collect_timing = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.395040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retries = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.395452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retry_delay = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.395892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.enable_notifications = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.396358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.endpoint_override = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.396773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.insecure = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.397178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.interface = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.397599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.keyfile = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.398006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.max_version = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.398425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.min_version = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.398831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.region_name = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.399237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_name = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.399671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_type = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.400082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.split_loggers = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.400653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retries = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.401085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retry_delay = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.401492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.timeout = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.401901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.valid_interfaces = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.402369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.version = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.402798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] cli_script.dry_run = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.403248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.403692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.404113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.404524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.404935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.405349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.405783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.406369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.406826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.407235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.407697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.408136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.408559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.408993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.409415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.409855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.410266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.410846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.411307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.411753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.412167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.412626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.413057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.413470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.413886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.414303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.414730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.415175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.415585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.416043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.416474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.416922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.driver = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.417338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.418076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.418493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.418932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.419343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.group = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.419775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.helper_command = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.420212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.420787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.thread_pool_size = 4 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.421201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.user = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.421680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.422670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.group = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.423318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.helper_command = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.423805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.424220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.424627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.user = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.425051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.425456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.group = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.425885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.426315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.426737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.427142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.user = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.427831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.capabilities = [21] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.428242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.group = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.428737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.helper_command = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.429156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.429663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.thread_pool_size = 4 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.430086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.user = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.430505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.capabilities = [12] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.431077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.group = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.431486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.helper_command = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.431931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.432436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.thread_pool_size = 4 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.432902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.user = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.433332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.capabilities = [12, 21] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.433910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.group = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.434318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.helper_command = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.434734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.435144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.thread_pool_size = 4 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.435546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.user = None {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.436003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_providers.service_provider = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.436630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.436999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent.extensions = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.437433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.default_quota = -1 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.438433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.438866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_network = 100 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.439302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_port = 500 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.439752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_rbac_policy = 10 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.440192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group = 100 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.440616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.441175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_subnet = 100 {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.441601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.track_quota_usage = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.442018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_ipset = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.442440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_security_group = True {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.442913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.443331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:47:36.443707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=107274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 09 00:47:36.529051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Flow_Table.name {{(pid=107274) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Oct 09 00:47:36.529348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Mirror.name {{(pid=107274) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Oct 09 00:47:36.529571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=107274) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 09 00:47:36.529793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=107274) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 09 00:47:36.530004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=107274) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 09 00:47:36.530200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Manager.target {{(pid=107274) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 09 00:47:36.626088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-int, may_exist=True, datapath_type=system) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:36.626896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow13', 'OpenFlow10', 'OpenFlow14')) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:36.627780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:36.633561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-int, mode=secure) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:36.638277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-int. {{(pid=107274) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Oct 09 00:47:36.638955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-int, targets=['tcp:127.0.0.1:6633']) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.649947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=41d7c167-540b-4873-a0ff-f19e82a9ef77, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.656391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=41d7c167-540b-4873-a0ff-f19e82a9ef77, col_values=(('inactivity_probe', 10000),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.662378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-int, col_values=(('mcast_snooping_enable', False),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.663288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mcast-snooping-disable-flood-unregistered': 'false'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.676160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-int has datapath-ID 0000027610d12c4f Oct 09 00:47:37.680324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0xbb2d52bf,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=23) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.682632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbb2d52c1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.684840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbb2d52c3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=59) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.696094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xbb2d52c5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=60) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.697823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0xbb2d52c7,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=24) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.699559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbb2d52c9,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'vlan_vid': 8191}),out_group=0,out_port=0,priority=65535,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.701898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xbb2d52cb,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=62) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.708949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbb2d52cd,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=30) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.711417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbb2d52cf,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=31) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:37.712441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.utils [-] Std library socket module is patched by eventlet. Requesting std library socket module from eventlet. {{(pid=107274) __init__ /opt/stack/neutron/neutron/agent/common/utils.py:91}} Oct 09 00:47:37.714476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Mapping physical network physnet1 to bridge br-data Oct 09 00:47:37.715305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Bridge br-data datapath-id = 0x0000363d1c19024d Oct 09 00:47:37.716009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-data, may_exist=True, datapath_type=system) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.716504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-data, column=protocols, values=('OpenFlow13', 'OpenFlow10', 'OpenFlow14')) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.717084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-data, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.722694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-data, mode=secure) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:37.731964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-data. {{(pid=107274) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Oct 09 00:47:37.732845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-data, targets=['tcp:127.0.0.1:6633']) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.747748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=3b435cf3-84fd-4776-a388-e23165065657, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.753175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=3b435cf3-84fd-4776-a388-e23165065657, col_values=(('inactivity_probe', 10000),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.758444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-data has datapath-ID 0000363d1c19024d Oct 09 00:47:38.761026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x32da1815,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:38.761832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-int, port=int-br-data, may_exist=True) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.762475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=int-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.788087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=int-br-data, col_values=(('other_config', {'mcast-snooping-flood-reports': 'False', 'mcast-snooping-flood': 'False'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.795387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-data, port=phy-br-data, may_exist=True) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.796079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.820936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbb2d52d1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:38.823365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x32da1817,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:38.824032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=int-br-data, col_values=(('options', {'peer': 'phy-br-data'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.840626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('options', {'peer': 'int-br-data'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:38.849138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Port {{(pid=107274) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 09 00:47:38.866129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroup {{(pid=107274) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 09 00:47:38.866997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroupRule {{(pid=107274) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 09 00:47:38.867856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Network {{(pid=107274) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 09 00:47:38.868828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Subnet {{(pid=107274) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 09 00:47:38.869616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for AddressGroup {{(pid=107274) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 09 00:47:39.129084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:39.129564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:39.129947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:39.130321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:39.130725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:39.131099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:39.173785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Init firewall settings (driver=openvswitch) {{(pid=107274) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:121}} Oct 09 00:47:39.176830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow12', 'OpenFlow11')) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:47:40.197070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eb92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:40.199159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eb94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:40.201320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eb96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:40.204034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eb98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:40.214393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eb9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:40.215031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.ip_conntrack [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Starting ip_conntrack _process_queue_worker() threads {{(pid=107274) _start_process_queue /opt/stack/neutron/neutron/agent/linux/ip_conntrack.py:80}} Oct 09 00:47:40.215489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:40.216778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpty4dwzuv/privsep.sock'] Oct 09 00:47:40.253797 dv-cinder-master-3-iscsi sudo[108963]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpty4dwzuv/privsep.sock Oct 09 00:47:40.254613 dv-cinder-master-3-iscsi sudo[108963]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 09 00:47:41.762928 dv-cinder-master-3-iscsi sudo[108963]: pam_unix(sudo:session): session closed for user root Oct 09 00:47:41.769577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Spawned new privsep daemon via rootwrap Oct 09 00:47:41.770123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Accepted privsep connection to /tmp/tmpty4dwzuv/privsep.sock {{(pid=107274) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Oct 09 00:47:41.771835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [-] privsep daemon starting Oct 09 00:47:41.772424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Oct 09 00:47:41.773250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none Oct 09 00:47:41.773704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 108976 Oct 09 00:47:41.777463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1160802-1dbb-49b3-afcf-c5d33982a31a]: (2,) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.428433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=108976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 09 00:47:42.429096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.000s {{(pid=108976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 09 00:47:42.429550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.000s {{(pid=108976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 09 00:47:42.665786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eab1da-b9b6-4a1e-9edb-e3bcb1d1aff3]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.666564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.675670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[f851c548-31c5-4c61-bf50-b33adb1d9468]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.676294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.685619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[da681bea-c579-43fa-8f7f-445d8e7a0eb8]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.686180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.696539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[317b8b39-c03a-4cdc-9937-c366e784e8be]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.697098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.708043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba63c7-f4c2-44b4-ab1c-b41f63e1a8a5]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.709094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.722416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3ef320-db78-4fdd-ae61-acac003d8498]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.723077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.744275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[359a041c-e8ef-4153-b795-89d259026338]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.744837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.767399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[b984e75e-aead-4918-abb9-70aebd7037de]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.768231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.789035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[99576169-5801-4c5c-b710-7b024a0b9c36]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.789649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Processing 1 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:47:42.804754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef8bb6-97e7-4a0e-a621-3d977490d061]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:42.805406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Subscribe: > agent ovs_restarted 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.805913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Subscribe: > SecurityGroupRule after_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.806236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Subscribe: > SecurityGroupRule after_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.806553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Subscribe: > Port after_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.806874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Subscribe: > Port after_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.807200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Subscribe: > AddressGroup after_update 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.807521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Subscribe: > AddressGroup after_delete 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.907707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.driver.init_handler-8765004091886'] for Open vSwitch agent (None), after_init {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:42.908240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Subscribe: > ovsdb after_read 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.909269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Subscribe: > Trunk before_create 55550000 {{(pid=107274) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 09 00:47:42.909637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Registering callback for Trunk {{(pid=107274) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 09 00:47:42.909942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Registering callback for SubPort {{(pid=107274) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 09 00:47:42.952168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Unregistering callback for Trunk {{(pid=107274) unregister /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:72}} Oct 09 00:47:42.952435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent initialized successfully, now running... Oct 09 00:47:42.954245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.ovs_vsctl_cmd', '--privsep_sock_path', '/tmp/tmp3b3tj68d/privsep.sock'] Oct 09 00:47:42.966986 dv-cinder-master-3-iscsi sudo[109027]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmp3b3tj68d/privsep.sock Oct 09 00:47:42.967945 dv-cinder-master-3-iscsi sudo[109027]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 09 00:47:44.184579 dv-cinder-master-3-iscsi sudo[109027]: pam_unix(sudo:session): session closed for user root Oct 09 00:47:44.194691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Spawned new privsep daemon via rootwrap Oct 09 00:47:44.195225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Accepted privsep connection to /tmp/tmp3b3tj68d/privsep.sock {{(pid=107274) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Oct 09 00:47:44.196223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [-] privsep daemon starting Oct 09 00:47:44.196504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Oct 09 00:47:44.196751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none Oct 09 00:47:44.196992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109031 Oct 09 00:47:44.199688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[62db969d-c048-4c35-a0ee-1fdaebbd26ee]: (2,) {{(pid=109031) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:44.409794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 {{(pid=109031) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 09 00:47:44.416474 dv-cinder-master-3-iscsi ovs-vsctl[109033]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=10 --id=@manager -- create Manager "target=\"ptcp:6640:127.0.0.1\"" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 Oct 09 00:47:44.418925 dv-cinder-master-3-iscsi ovs-vsctl[109033]: ovs|00002|db_ctl_base|ERR|multiple rows in Manager match "ptcp:6640:127.0.0.1" Oct 09 00:47:44.420663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo_concurrency.processutils [-] CMD "ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000" returned: 1 in 0.011s {{(pid=109031) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 09 00:47:44.421045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[81646d7a-e096-44b0-a1fc-5a0af1be143d]: (4, ('', 'ovs-vsctl: multiple rows in Manager match "ptcp:6640:127.0.0.1"\n')) {{(pid=109031) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:47:44.421728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Launching async process [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]. {{(pid=107274) start /opt/stack/neutron/neutron/agent/common/async_process.py:117}} Oct 09 00:47:44.422157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Running command: ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] {{(pid=107274) create_process /opt/stack/neutron/neutron/agent/linux/utils.py:84}} Oct 09 00:47:44.429289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:44.429931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:0 started Oct 09 00:47:44.434212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eb9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=754000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.435766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["47142e99-33de-4bef-8e30-2ad1c4596320","initial","phy-br-data",2,["map",[]]],["88a1d973-4906-4d28-94bb-f4406fabbd0e","initial","int-br-data",1,["map",[]]],["e2659de0-80dc-486f-b86c-9f9ee93c1eee","initial","br-data",65534,["map",[]]],["932b77eb-ccde-4304-8b3b-9e59da7604db","initial","br-int",65534,["map",[]]],["3a0c0c63-cec0-463c-bc47-4892a2494ae9","initial","eth1",1,["map",[]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:47:44.436253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:44.436842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:0 - starting polling. Elapsed:0.007 Oct 09 00:47:44.438789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:44.439858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:0 - port information retrieved. Elapsed:0.010 Oct 09 00:47:44.440228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Cleaning stale br-int flows Oct 09 00:47:44.440610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reserved cookies for br-int: {9214758823016176915} Oct 09 00:47:44.443491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eb9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=743000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'vlan_vid': 8191}),packet_count=0,priority=65535,table_id=0), OFPFlowStats(byte_count=1041,cookie=9214758823016176915,duration_nsec=634000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 1}),packet_count=3,priority=2,table_id=0), OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=760000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=0)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.445465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eba0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.447299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eba2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.449381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eba4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=770000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.451480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eba6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=24,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=754000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=24)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.453374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eba8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=25,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.455956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebaa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=61,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.458142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=30,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=753000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=30)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.460281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=31,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=748000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=31)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.462405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=59,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=777000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=59)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.464796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=60,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=773000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=60)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.467084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=62,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=765000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=62)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.470035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=748000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionCTClear(experimenter=8992,len=16,subtype=43,type=65535), NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=71,type=65535)],len=40,type=4)],length=104,match=OFPMatch(oxm_fields={'ct_state': (32, 32)}),packet_count=0,priority=110,table_id=71), OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=804000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=71)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.472098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=797000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=72)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.474099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=789000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=73)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.475933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=77,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.477751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=78,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.479772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=784000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=81)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.481765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=775000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=82)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.484106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=91,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=728000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=94,type=65535)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=1,table_id=91)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.486167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=92,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=707000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=92)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.488211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=93,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=685000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=93)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.488527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Cleaning stale br-data flows Oct 09 00:47:44.488818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reserved cookies for br-data: {1503099881718125406} Oct 09 00:47:44.491478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x32da1819,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=1503099881718125406,duration_nsec=668000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 2}),packet_count=0,priority=2,table_id=0), OFPFlowStats(byte_count=1041,cookie=1503099881718125406,duration_nsec=730000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=3,priority=0,table_id=0)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.493333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x32da181b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.495137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x32da181d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.497420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x32da181f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=3,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:44.498008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:0 - cleanup stale flows. Elapsed:0.068 Oct 09 00:47:44.498354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:0 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.069 Oct 09 00:47:46.431097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:1 started Oct 09 00:47:46.433578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=754000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:46.434136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:46.434491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:1 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:47:48.432273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:2 started Oct 09 00:47:48.434767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebcc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=756000000,duration_sec=10,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:48.435333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:48.435715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:2 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:47:48.782997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING oslo_policy.policy [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Oct 09 00:47:48.783467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING oslo_policy.policy [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Oct 09 00:47:48.787486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:47:48Z,description='Default security group',id=79a0c5c7-165a-4db0-9cd0-ed66a1545ba7,is_default=True,name='default',project_id='768d646302f443f1a7d490b8c3d4bdbb',revision_number=1,rules=[SecurityGroupRule(621dfe69-a6f5-4f89-bda1-d9328c795105),SecurityGroupRule(79d35981-0c71-42bf-90ec-025699b28dca),SecurityGroupRule(8e5fdeb6-fef8-4925-a8d0-e5a8201af283),SecurityGroupRule(ad93697f-4cd1-4fa3-8d65-e87e597e5b21)],shared=False,stateful=True,updated_at=2022-10-09T00:47:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:47:48.787936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (79a0c5c7-165a-4db0-9cd0-ed66a1545ba7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:48.788678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:47:48Z,description=,direction='egress',ethertype='IPv6',id=621dfe69-a6f5-4f89-bda1-d9328c795105,normalized_cidr=None,port_range_max=,port_range_min=,project_id='768d646302f443f1a7d490b8c3d4bdbb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=79a0c5c7-165a-4db0-9cd0-ed66a1545ba7,updated_at=2022-10-09T00:47:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:47:48.788952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (621dfe69-a6f5-4f89-bda1-d9328c795105), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:48.789311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Security group rule updated ['79a0c5c7-165a-4db0-9cd0-ed66a1545ba7'] Oct 09 00:47:48.790047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:47:48Z,description=,direction='ingress',ethertype='IPv4',id=79d35981-0c71-42bf-90ec-025699b28dca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='768d646302f443f1a7d490b8c3d4bdbb',protocol=,remote_address_group_id=,remote_group_id=79a0c5c7-165a-4db0-9cd0-ed66a1545ba7,remote_ip_prefix=,revision_number=0,security_group_id=79a0c5c7-165a-4db0-9cd0-ed66a1545ba7,updated_at=2022-10-09T00:47:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:47:48.790375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (79d35981-0c71-42bf-90ec-025699b28dca), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:48.790708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Security group rule updated ['79a0c5c7-165a-4db0-9cd0-ed66a1545ba7'] Oct 09 00:47:48.791367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:47:48Z,description=,direction='egress',ethertype='IPv4',id=8e5fdeb6-fef8-4925-a8d0-e5a8201af283,normalized_cidr=None,port_range_max=,port_range_min=,project_id='768d646302f443f1a7d490b8c3d4bdbb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=79a0c5c7-165a-4db0-9cd0-ed66a1545ba7,updated_at=2022-10-09T00:47:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:47:48.791747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8e5fdeb6-fef8-4925-a8d0-e5a8201af283), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:48.792082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Security group rule updated ['79a0c5c7-165a-4db0-9cd0-ed66a1545ba7'] Oct 09 00:47:48.792747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:47:48Z,description=,direction='ingress',ethertype='IPv6',id=ad93697f-4cd1-4fa3-8d65-e87e597e5b21,normalized_cidr=None,port_range_max=,port_range_min=,project_id='768d646302f443f1a7d490b8c3d4bdbb',protocol=,remote_address_group_id=,remote_group_id=79a0c5c7-165a-4db0-9cd0-ed66a1545ba7,remote_ip_prefix=,revision_number=0,security_group_id=79a0c5c7-165a-4db0-9cd0-ed66a1545ba7,updated_at=2022-10-09T00:47:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:47:48.793101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ad93697f-4cd1-4fa3-8d65-e87e597e5b21), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:48.793427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Security group rule updated ['79a0c5c7-165a-4db0-9cd0-ed66a1545ba7'] Oct 09 00:47:48.955646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:47:48Z,description='',dns_domain=None,id=0b6608dd-57b2-4ef5-a30d-57830b80e501,mtu=1500,name='private',project_id='768d646302f443f1a7d490b8c3d4bdbb',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(0b6608dd-57b2-4ef5-a30d-57830b80e501),segments=[NetworkSegment(39b8301a-c0c3-479e-baef-efb75423b630)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:47:48Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:47:48.956040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (0b6608dd-57b2-4ef5-a30d-57830b80e501), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-695fa508-70f2-493e-b17e-07bdd99458de demo demo] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 0b6608dd-57b2-4ef5-a30d-57830b80e501 with segmentation id not found. Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:47:49.100163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:47:49.101298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:47:49.101298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:47:49.101298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:47:49.101298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 0b6608dd-57b2-4ef5-a30d-57830b80e501 with segmentation id not found. Oct 09 00:47:49.101298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:47:50.433808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:3 started Oct 09 00:47:50.436520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=757000000,duration_sec=12,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:50.437071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:50.437429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:3 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:47:52.434316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:4 started Oct 09 00:47:52.436926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=758000000,duration_sec=14,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:52.437681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:52.438102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:4 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:47:52.457030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0bb3249d-b229-4a6c-b925-0cc10a46d1e4 demo admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(3c727085-6bdc-425c-a70a-cfcf4b77eebd)],cidr=172.20.0.0/26,created_at=2022-10-09T00:47:52Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=50c3af93-7cea-4a3f-ac83-5f6ed98079bb,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='private-subnet',network_id=0b6608dd-57b2-4ef5-a30d-57830b80e501,project_id='768d646302f443f1a7d490b8c3d4bdbb',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id='0d6f73fc-20ab-41fb-b22f-e24653ad9af6',updated_at=2022-10-09T00:47:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:47:52.457440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0bb3249d-b229-4a6c-b925-0cc10a46d1e4 demo admin] Publish callbacks [] for Subnet (50c3af93-7cea-4a3f-ac83-5f6ed98079bb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:53.485178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-58b66bb1-4b72-4d8a-9b23-48494a2a2333 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:47:52Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0b6608dd-57b2-4ef5-a30d-57830b80e501',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8909d97f-c5e3-462a-9bad-225ac2909771,mac_address=fa:16:3e:63:33:6c,name='',network_id=0b6608dd-57b2-4ef5-a30d-57830b80e501,numa_affinity_policy=,project_id='768d646302f443f1a7d490b8c3d4bdbb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8909d97f-c5e3-462a-9bad-225ac2909771),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:47:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:47:53.485876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-58b66bb1-4b72-4d8a-9b23-48494a2a2333 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8909d97f-c5e3-462a-9bad-225ac2909771), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:53.709852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-58b66bb1-4b72-4d8a-9b23-48494a2a2333 None None] Resource Port 8909d97f-c5e3-462a-9bad-225ac2909771 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8909d97f-c5e3-462a-9bad-225ac2909771,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8909d97f-c5e3-462a-9bad-225ac2909771,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8909d97f-c5e3-462a-9bad-225ac2909771,segment=NetworkSegment(39b8301a-c0c3-479e-baef-efb75423b630),segment_id=39b8301a-c0c3-479e-baef-efb75423b630)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:47:53.710247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-58b66bb1-4b72-4d8a-9b23-48494a2a2333 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8909d97f-c5e3-462a-9bad-225ac2909771), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:54.435119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:5 started Oct 09 00:47:54.438049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=759000000,duration_sec=16,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:54.439214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:54.439756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:5 - starting polling. Elapsed:0.005 Oct 09 00:47:54.440846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:47:54.441678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:5 - port information retrieved. Elapsed:0.007 Oct 09 00:47:54.442006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:5 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 00:47:56.435899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:6 started Oct 09 00:47:56.438499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=759000000,duration_sec=18,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:56.439723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:56.440085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:6 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:47:58.436709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:7 started Oct 09 00:47:58.439050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=760000000,duration_sec=20,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:47:58.439646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:47:58.439997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:7 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:48:00.372967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["479d7956-b723-4d5c-aa41-aeb31ff56dc1","insert","tap8909d97f-c5",["set",[]],["map",[["attached-mac","fa:16:3e:63:33:6c"],["iface-id","8909d97f-c5e3-462a-9bad-225ac2909771"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:48:00.384380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["479d7956-b723-4d5c-aa41-aeb31ff56dc1","old",null,["set",[]],null],["","new","tap8909d97f-c5",2,["map",[["attached-mac","fa:16:3e:63:33:6c"],["iface-id","8909d97f-c5e3-462a-9bad-225ac2909771"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:48:00.438100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:8 started Oct 09 00:48:00.441550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=762000000,duration_sec=22,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:00.442188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:00.442722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:8 - starting polling. Elapsed:0.005 Oct 09 00:48:00.443793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:00.444909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:8 - port information retrieved. Elapsed:0.007 Oct 09 00:48:00.445308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'8909d97f-c5e3-462a-9bad-225ac2909771'}, 'added': {'8909d97f-c5e3-462a-9bad-225ac2909771'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:48:00.445998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '8909d97f-c5e3-462a-9bad-225ac2909771', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0b6608dd-57b2-4ef5-a30d-57830b80e501', 'network_id': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'port_id': '8909d97f-c5e3-462a-9bad-225ac2909771', 'mac_address': 'fa:16:3e:63:33:6c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '50c3af93-7cea-4a3f-ac83-5f6ed98079bb', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:48:00.446905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 8909d97f-c5e3-462a-9bad-225ac2909771 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:48:00.447364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8909d97f-c5e3-462a-9bad-225ac2909771 updated. Details: {'device': '8909d97f-c5e3-462a-9bad-225ac2909771', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0b6608dd-57b2-4ef5-a30d-57830b80e501', 'network_id': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'port_id': '8909d97f-c5e3-462a-9bad-225ac2909771', 'mac_address': 'fa:16:3e:63:33:6c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '50c3af93-7cea-4a3f-ac83-5f6ed98079bb', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:48:00.447799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 1 as local vlan for net-id=0b6608dd-57b2-4ef5-a30d-57830b80e501, seg-id=663 Oct 09 00:48:00.451219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da1821,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4759), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4097}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:00.453304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363ebda,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4097)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4759}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:00.454373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8909d97f-c5, col_values=(('tag', 1),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:00.454819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap8909d97f-c5, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:00.455409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap8909d97f-c5, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:00.464065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8909d97f-c5, col_values=(('other_config', {'net_uuid': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '663'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:00.470895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ebdc,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:00.471255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:8 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.026 Oct 09 00:48:00.471872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:48:00.472677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'8909d97f-c5e3-462a-9bad-225ac2909771'} Oct 09 00:48:00.474060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:48:00.474351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:48:00.477974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:48:00.516514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e74c13-df19-4909-b5f7-66bc93ba5d1b]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:48:00.517192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:8 - agent port security group processed in 0.071 Oct 09 00:48:00.517878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 8909d97f-c5e3-462a-9bad-225ac2909771 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:48:00.758972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['8909d97f-c5e3-462a-9bad-225ac2909771'] and devices down [] completed. Oct 09 00:48:00.759297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:8 - ports processed. Elapsed:0.321 Oct 09 00:48:00.759665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:8 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.322 Oct 09 00:48:00.814995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 8909d97f-c5e3-462a-9bad-225ac2909771 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:48:00.815397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8909d97f-c5e3-462a-9bad-225ac2909771), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:02.439685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:9 started Oct 09 00:48:02.442137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=763000000,duration_sec=24,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:02.442709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:02.443067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:9 - starting polling. Elapsed:0.004 Oct 09 00:48:02.444067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:02.444931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:9 - port information retrieved. Elapsed:0.006 Oct 09 00:48:02.445246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'8909d97f-c5e3-462a-9bad-225ac2909771'}, 'added': set(), 'removed': set(), 'updated': {'8909d97f-c5e3-462a-9bad-225ac2909771'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:48:02.445802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '8909d97f-c5e3-462a-9bad-225ac2909771', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0b6608dd-57b2-4ef5-a30d-57830b80e501', 'network_id': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'port_id': '8909d97f-c5e3-462a-9bad-225ac2909771', 'mac_address': 'fa:16:3e:63:33:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '50c3af93-7cea-4a3f-ac83-5f6ed98079bb', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:48:02.446607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 8909d97f-c5e3-462a-9bad-225ac2909771 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:48:02.446924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8909d97f-c5e3-462a-9bad-225ac2909771 updated. Details: {'device': '8909d97f-c5e3-462a-9bad-225ac2909771', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0b6608dd-57b2-4ef5-a30d-57830b80e501', 'network_id': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'port_id': '8909d97f-c5e3-462a-9bad-225ac2909771', 'mac_address': 'fa:16:3e:63:33:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '50c3af93-7cea-4a3f-ac83-5f6ed98079bb', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Oct 09 00:48:02.447918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8909d97f-c5, col_values=(('tag', 1),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:02.448335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap8909d97f-c5, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:02.448720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap8909d97f-c5, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:02.449151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:48:02.449884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8909d97f-c5, col_values=(('other_config', {'net_uuid': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '663', 'tag': '1'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:02.450547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:48:02.452701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ebe0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:02.453033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:9 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.007 Oct 09 00:48:02.453376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:48:02.453663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:48:02.455412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:48:02.455758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:48:02.457329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:48:02.503068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[0415c28c-4fd5-43c0-bec6-9d1c68af7661]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:48:02.503647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:9 - agent port security group processed in 0.058 Oct 09 00:48:02.504201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 8909d97f-c5e3-462a-9bad-225ac2909771 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:48:02.631184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['8909d97f-c5e3-462a-9bad-225ac2909771'] and devices down [] completed. Oct 09 00:48:02.631573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:9 - ports processed. Elapsed:0.193 Oct 09 00:48:02.632008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:9 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.193 Oct 09 00:48:04.440167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:10 started Oct 09 00:48:04.442557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebe2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=763000000,duration_sec=26,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:04.443122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:04.443474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:10 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:48:06.441275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:11 started Oct 09 00:48:06.443754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebe4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=765000000,duration_sec=28,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:06.444306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:06.444659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:11 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:08.438705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:48:08Z,description='Default security group',id=b8892b1a-9ebe-457a-96be-1c5ae1fe227d,is_default=True,name='default',project_id='34e0fbee16724df3abcac7131a4822aa',revision_number=1,rules=[SecurityGroupRule(1a71b787-475f-478f-b789-1e6a6e3f6f5f),SecurityGroupRule(7111ac09-c9f4-44ed-a83d-4a675354346d),SecurityGroupRule(8ded6060-1362-426b-9b50-39395067fc6d),SecurityGroupRule(9bed3637-da5a-4937-90d5-933f44a20062)],shared=False,stateful=True,updated_at=2022-10-09T00:48:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:08.439925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (b8892b1a-9ebe-457a-96be-1c5ae1fe227d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:08.440364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:48:08Z,description=,direction='egress',ethertype='IPv6',id=1a71b787-475f-478f-b789-1e6a6e3f6f5f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='34e0fbee16724df3abcac7131a4822aa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8892b1a-9ebe-457a-96be-1c5ae1fe227d,updated_at=2022-10-09T00:48:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:08.440740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1a71b787-475f-478f-b789-1e6a6e3f6f5f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:08.441120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Security group rule updated ['b8892b1a-9ebe-457a-96be-1c5ae1fe227d'] Oct 09 00:48:08.441864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:48:08Z,description=,direction='ingress',ethertype='IPv6',id=7111ac09-c9f4-44ed-a83d-4a675354346d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='34e0fbee16724df3abcac7131a4822aa',protocol=,remote_address_group_id=,remote_group_id=b8892b1a-9ebe-457a-96be-1c5ae1fe227d,remote_ip_prefix=,revision_number=0,security_group_id=b8892b1a-9ebe-457a-96be-1c5ae1fe227d,updated_at=2022-10-09T00:48:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:08.442186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7111ac09-c9f4-44ed-a83d-4a675354346d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:08.442522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Security group rule updated ['b8892b1a-9ebe-457a-96be-1c5ae1fe227d'] Oct 09 00:48:08.443171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:48:08Z,description=,direction='egress',ethertype='IPv4',id=8ded6060-1362-426b-9b50-39395067fc6d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='34e0fbee16724df3abcac7131a4822aa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8892b1a-9ebe-457a-96be-1c5ae1fe227d,updated_at=2022-10-09T00:48:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:08.443549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8ded6060-1362-426b-9b50-39395067fc6d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:08.444019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Security group rule updated ['b8892b1a-9ebe-457a-96be-1c5ae1fe227d'] Oct 09 00:48:08.444682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:48:08Z,description=,direction='ingress',ethertype='IPv4',id=9bed3637-da5a-4937-90d5-933f44a20062,normalized_cidr=None,port_range_max=,port_range_min=,project_id='34e0fbee16724df3abcac7131a4822aa',protocol=,remote_address_group_id=,remote_group_id=b8892b1a-9ebe-457a-96be-1c5ae1fe227d,remote_ip_prefix=,revision_number=0,security_group_id=b8892b1a-9ebe-457a-96be-1c5ae1fe227d,updated_at=2022-10-09T00:48:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:08.445032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9bed3637-da5a-4937-90d5-933f44a20062), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:08.445363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Security group rule updated ['b8892b1a-9ebe-457a-96be-1c5ae1fe227d'] Oct 09 00:48:08.446243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:12 started Oct 09 00:48:08.448537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebe6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=770000000,duration_sec=30,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:08.449736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:08.450125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:12 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:08.590674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:48:08Z,description='',dns_domain=None,id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,mtu=1500,name='public',project_id='34e0fbee16724df3abcac7131a4822aa',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(3d48f00d-dd5a-4867-a3e0-929aeb72c042),segments=[NetworkSegment(466209de-cb09-4473-8033-6597828bc645)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:48:08Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:08.591186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-33bcdd9f-67d5-4ff6-9636-38106fdf9c87 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (3d48f00d-dd5a-4867-a3e0-929aeb72c042), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:10.447755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:13 started Oct 09 00:48:10.450156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebe8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=771000000,duration_sec=32,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:10.450944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:10.451299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:13 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:12.449012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:14 started Oct 09 00:48:12.451418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=772000000,duration_sec=34,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:12.452041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:12.452392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:14 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:12.678093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-384a15d9-636b-40ce-894b-a323e99138ac demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:48:11Z,data_plane_status=None,description='',device_id='5405c7e9-ad50-4474-b96c-4853d3358e50',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6fc925b8-cc04-47c9-908d-92ab057747b2,mac_address=fa:16:3e:bd:bd:46,name='',network_id=0b6608dd-57b2-4ef5-a30d-57830b80e501,numa_affinity_policy=,project_id='768d646302f443f1a7d490b8c3d4bdbb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6fc925b8-cc04-47c9-908d-92ab057747b2),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:48:12Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:12.678626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-384a15d9-636b-40ce-894b-a323e99138ac demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6fc925b8-cc04-47c9-908d-92ab057747b2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:13.159898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-384a15d9-636b-40ce-894b-a323e99138ac demo admin] Received resource Port update without any changes: 6fc925b8-cc04-47c9-908d-92ab057747b2 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 00:48:14.449970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:15 started Oct 09 00:48:14.452453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=773000000,duration_sec=36,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:14.453016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:14.453351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:15 - starting polling. Elapsed:0.004 Oct 09 00:48:14.454310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:14.455173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:15 - port information retrieved. Elapsed:0.005 Oct 09 00:48:14.456062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:15 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:48:14.892469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9abe877c-76f6-4fa6-8929-3675f72a6ab1 None None] Resource Port 6fc925b8-cc04-47c9-908d-92ab057747b2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=6fc925b8-cc04-47c9-908d-92ab057747b2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6fc925b8-cc04-47c9-908d-92ab057747b2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:48:14.893363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9abe877c-76f6-4fa6-8929-3675f72a6ab1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6fc925b8-cc04-47c9-908d-92ab057747b2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:15.130348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9abe877c-76f6-4fa6-8929-3675f72a6ab1 None None] Resource Port 6fc925b8-cc04-47c9-908d-92ab057747b2 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6fc925b8-cc04-47c9-908d-92ab057747b2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6fc925b8-cc04-47c9-908d-92ab057747b2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6fc925b8-cc04-47c9-908d-92ab057747b2,segment=NetworkSegment(39b8301a-c0c3-479e-baef-efb75423b630),segment_id=39b8301a-c0c3-479e-baef-efb75423b630)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:48:15.130741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9abe877c-76f6-4fa6-8929-3675f72a6ab1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6fc925b8-cc04-47c9-908d-92ab057747b2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:16.451398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:16 started Oct 09 00:48:16.453992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=775000000,duration_sec=38,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:16.454553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:16.454888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:16 - starting polling. Elapsed:0.004 Oct 09 00:48:16.455908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:16.456768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:16 - port information retrieved. Elapsed:0.006 Oct 09 00:48:16.457096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:16 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:48:16.885459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-af3ad23b-d336-4e70-8e70-93ac645fb9af admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(f71d58d6-c356-4b31-b550-9313ad292912)],cidr=172.37.5.0/24,created_at=2022-10-09T00:48:16Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.37.5.1,host_routes=[],id=6f92119b-fe6b-47bd-9d10-bb5087854d0d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='public-subnet',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,project_id='34e0fbee16724df3abcac7131a4822aa',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:48:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:16.885833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-af3ad23b-d336-4e70-8e70-93ac645fb9af admin admin] Publish callbacks [] for Subnet (6f92119b-fe6b-47bd-9d10-bb5087854d0d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:18.452267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:17 started Oct 09 00:48:18.456009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebf0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=776000000,duration_sec=40,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:18.456743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:18.457099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:17 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:48:20.083198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["67181b9f-4425-45d8-9a59-dfc29767a321","insert","qr-6fc925b8-cc",["set",[]],["map",[["attached-mac","fa:16:3e:bd:bd:46"],["iface-id","6fc925b8-cc04-47c9-908d-92ab057747b2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:48:20.107877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["67181b9f-4425-45d8-9a59-dfc29767a321","old",null,["set",[]],null],["","new","qr-6fc925b8-cc",3,["map",[["attached-mac","fa:16:3e:bd:bd:46"],["iface-id","6fc925b8-cc04-47c9-908d-92ab057747b2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:48:20.452754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:18 started Oct 09 00:48:20.455202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebf2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=776000000,duration_sec=42,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:20.456368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:20.456836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:18 - starting polling. Elapsed:0.004 Oct 09 00:48:20.457916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:20.458940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:18 - port information retrieved. Elapsed:0.006 Oct 09 00:48:20.459266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'8909d97f-c5e3-462a-9bad-225ac2909771', '6fc925b8-cc04-47c9-908d-92ab057747b2'}, 'added': {'6fc925b8-cc04-47c9-908d-92ab057747b2'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:48:20.459858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '6fc925b8-cc04-47c9-908d-92ab057747b2', 'device_id': '5405c7e9-ad50-4474-b96c-4853d3358e50', 'network_id': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'port_id': '6fc925b8-cc04-47c9-908d-92ab057747b2', 'mac_address': 'fa:16:3e:bd:bd:46', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '50c3af93-7cea-4a3f-ac83-5f6ed98079bb', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:48:20.460819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 6fc925b8-cc04-47c9-908d-92ab057747b2 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:48:20.461139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 6fc925b8-cc04-47c9-908d-92ab057747b2 updated. Details: {'device': '6fc925b8-cc04-47c9-908d-92ab057747b2', 'device_id': '5405c7e9-ad50-4474-b96c-4853d3358e50', 'network_id': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'port_id': '6fc925b8-cc04-47c9-908d-92ab057747b2', 'mac_address': 'fa:16:3e:bd:bd:46', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '50c3af93-7cea-4a3f-ac83-5f6ed98079bb', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Oct 09 00:48:20.462104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6fc925b8-cc, col_values=(('tag', 1),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:20.462528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-6fc925b8-cc, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:20.462963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-6fc925b8-cc, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:20.470588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6fc925b8-cc, col_values=(('other_config', {'net_uuid': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '663'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:20.480248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ebf4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:20.480574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:18 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.021 Oct 09 00:48:20.480928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:48:20.481228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'6fc925b8-cc04-47c9-908d-92ab057747b2'} Oct 09 00:48:20.482377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:48:20.482661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:48:20.484517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:48:20.521680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aca38a-3eec-4ee5-85fa-1fca8e364c4f]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:48:20.522298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:18 - agent port security group processed in 0.063 Oct 09 00:48:20.522869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 6fc925b8-cc04-47c9-908d-92ab057747b2 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:48:20.687051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['6fc925b8-cc04-47c9-908d-92ab057747b2'] and devices down [] completed. Oct 09 00:48:20.687051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:18 - ports processed. Elapsed:0.234 Oct 09 00:48:20.687051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:18 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.234 Oct 09 00:48:20.740412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 6fc925b8-cc04-47c9-908d-92ab057747b2 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:48:20.740916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6fc925b8-cc04-47c9-908d-92ab057747b2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:21.090088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-86ea3621-0f9f-4239-85d6-1420e5232a0c demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:48:20Z,data_plane_status=None,description='',device_id='5405c7e9-ad50-4474-b96c-4853d3358e50',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=25cba434-73ae-44ab-aa76-d477a015b1c7,mac_address=fa:16:3e:31:26:79,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(25cba434-73ae-44ab-aa76-d477a015b1c7),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:48:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:48:21.090707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-86ea3621-0f9f-4239-85d6-1420e5232a0c demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (25cba434-73ae-44ab-aa76-d477a015b1c7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:22.455215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:19 started Oct 09 00:48:22.457712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebf6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=778000000,duration_sec=44,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:22.458458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:22.458991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:19 - starting polling. Elapsed:0.005 Oct 09 00:48:22.460230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:22.461417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:19 - port information retrieved. Elapsed:0.007 Oct 09 00:48:22.464002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'8909d97f-c5e3-462a-9bad-225ac2909771', '6fc925b8-cc04-47c9-908d-92ab057747b2'}, 'added': set(), 'removed': set(), 'updated': {'6fc925b8-cc04-47c9-908d-92ab057747b2'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:48:22.464707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '6fc925b8-cc04-47c9-908d-92ab057747b2', 'device_id': '5405c7e9-ad50-4474-b96c-4853d3358e50', 'network_id': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'port_id': '6fc925b8-cc04-47c9-908d-92ab057747b2', 'mac_address': 'fa:16:3e:bd:bd:46', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '50c3af93-7cea-4a3f-ac83-5f6ed98079bb', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:48:22.467428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 6fc925b8-cc04-47c9-908d-92ab057747b2 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:48:22.467928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 6fc925b8-cc04-47c9-908d-92ab057747b2 updated. Details: {'device': '6fc925b8-cc04-47c9-908d-92ab057747b2', 'device_id': '5405c7e9-ad50-4474-b96c-4853d3358e50', 'network_id': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'port_id': '6fc925b8-cc04-47c9-908d-92ab057747b2', 'mac_address': 'fa:16:3e:bd:bd:46', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 663, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '50c3af93-7cea-4a3f-ac83-5f6ed98079bb', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Oct 09 00:48:22.469181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6fc925b8-cc, col_values=(('tag', 1),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:22.469860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-6fc925b8-cc, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:22.470253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-6fc925b8-cc, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:22.470909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:48:22.472971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6fc925b8-cc, col_values=(('other_config', {'net_uuid': '0b6608dd-57b2-4ef5-a30d-57830b80e501', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '663', 'tag': '1'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:22.473796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:48:22.478169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ebf8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:22.478690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:19 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.014 Oct 09 00:48:22.479199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:48:22.479621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:48:22.480902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:48:22.483626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:48:22.485515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:48:22.543628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc40e921-a47e-48f4-a431-50ec70534126]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:48:22.543628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:19 - agent port security group processed in 0.078 Oct 09 00:48:22.543628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 6fc925b8-cc04-47c9-908d-92ab057747b2 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:48:22.860670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['6fc925b8-cc04-47c9-908d-92ab057747b2'] and devices down [] completed. Oct 09 00:48:22.860991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:19 - ports processed. Elapsed:0.407 Oct 09 00:48:22.861328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:19 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.407 Oct 09 00:48:22.992790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e81f3a70-3e93-4b6c-92fb-a8fbec96ac11 None None] Resource Port 25cba434-73ae-44ab-aa76-d477a015b1c7 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=25cba434-73ae-44ab-aa76-d477a015b1c7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=25cba434-73ae-44ab-aa76-d477a015b1c7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:48:22.993836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e81f3a70-3e93-4b6c-92fb-a8fbec96ac11 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (25cba434-73ae-44ab-aa76-d477a015b1c7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:23.164923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e81f3a70-3e93-4b6c-92fb-a8fbec96ac11 None None] Resource Port 25cba434-73ae-44ab-aa76-d477a015b1c7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=25cba434-73ae-44ab-aa76-d477a015b1c7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=25cba434-73ae-44ab-aa76-d477a015b1c7,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=25cba434-73ae-44ab-aa76-d477a015b1c7,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:48:23.165513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e81f3a70-3e93-4b6c-92fb-a8fbec96ac11 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (25cba434-73ae-44ab-aa76-d477a015b1c7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:23.488947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7d248cc1-5329-48d7-8e87-6c5b04c6686d","insert","qg-25cba434-73",["set",[]],["map",[["attached-mac","fa:16:3e:31:26:79"],["iface-id","25cba434-73ae-44ab-aa76-d477a015b1c7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:48:23.505420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7d248cc1-5329-48d7-8e87-6c5b04c6686d","old",null,["set",[]],null],["","new","qg-25cba434-73",4,["map",[["attached-mac","fa:16:3e:31:26:79"],["iface-id","25cba434-73ae-44ab-aa76-d477a015b1c7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:48:24.455392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:20 started Oct 09 00:48:24.457757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ebfa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=779000000,duration_sec=46,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:24.458318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:24.458774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:20 - starting polling. Elapsed:0.004 Oct 09 00:48:24.459949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:24.461116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:20 - port information retrieved. Elapsed:0.006 Oct 09 00:48:24.461440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '8909d97f-c5e3-462a-9bad-225ac2909771', '6fc925b8-cc04-47c9-908d-92ab057747b2'}, 'added': {'25cba434-73ae-44ab-aa76-d477a015b1c7'}, 'removed': set(), 'updated': {'25cba434-73ae-44ab-aa76-d477a015b1c7'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:48:24.462028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '25cba434-73ae-44ab-aa76-d477a015b1c7', 'device_id': '5405c7e9-ad50-4474-b96c-4853d3358e50', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '25cba434-73ae-44ab-aa76-d477a015b1c7', 'mac_address': 'fa:16:3e:31:26:79', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.51'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:48:24.463182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 25cba434-73ae-44ab-aa76-d477a015b1c7 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:48:24.463517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 25cba434-73ae-44ab-aa76-d477a015b1c7 updated. Details: {'device': '25cba434-73ae-44ab-aa76-d477a015b1c7', 'device_id': '5405c7e9-ad50-4474-b96c-4853d3358e50', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '25cba434-73ae-44ab-aa76-d477a015b1c7', 'mac_address': 'fa:16:3e:31:26:79', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.51'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:48:24.463872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 2 as local vlan for net-id=3d48f00d-dd5a-4867-a3e0-929aeb72c042, seg-id=None Oct 09 00:48:24.466388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x32da1823,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPopVlan(len=8,type=18), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=32,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4098}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:24.468721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x363ebfc,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPushVlan(ethertype=33024,len=8,type=17), OFPActionSetField(vlan_vid=4098)],len=32,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 0}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:24.469650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-25cba434-73, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:24.470072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-25cba434-73, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:24.470503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-25cba434-73, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:24.478084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-25cba434-73, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:24.491254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ebfe,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:24.491862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:20 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.030 Oct 09 00:48:24.491976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:48:24.492274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'25cba434-73ae-44ab-aa76-d477a015b1c7'} Oct 09 00:48:24.493405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:48:24.493690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:48:24.495562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:48:24.531070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d0b7f-bae0-4def-854c-5509f55bacd6]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:48:24.531713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:20 - agent port security group processed in 0.070 Oct 09 00:48:24.532301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 25cba434-73ae-44ab-aa76-d477a015b1c7 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:48:24.682766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['25cba434-73ae-44ab-aa76-d477a015b1c7'] and devices down [] completed. Oct 09 00:48:24.683087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:20 - ports processed. Elapsed:0.228 Oct 09 00:48:24.683425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:20 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.228 Oct 09 00:48:24.735156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 25cba434-73ae-44ab-aa76-d477a015b1c7 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=25cba434-73ae-44ab-aa76-d477a015b1c7,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=25cba434-73ae-44ab-aa76-d477a015b1c7,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:48:24.735548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (25cba434-73ae-44ab-aa76-d477a015b1c7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:26.456504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:21 started Oct 09 00:48:26.459362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=780000000,duration_sec=48,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:26.459964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:26.460299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:21 - starting polling. Elapsed:0.004 Oct 09 00:48:26.461435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:48:26.462618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:21 - port information retrieved. Elapsed:0.006 Oct 09 00:48:26.462940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '8909d97f-c5e3-462a-9bad-225ac2909771', '6fc925b8-cc04-47c9-908d-92ab057747b2'}, 'added': set(), 'removed': set(), 'updated': {'25cba434-73ae-44ab-aa76-d477a015b1c7'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:48:26.463516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '25cba434-73ae-44ab-aa76-d477a015b1c7', 'device_id': '5405c7e9-ad50-4474-b96c-4853d3358e50', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '25cba434-73ae-44ab-aa76-d477a015b1c7', 'mac_address': 'fa:16:3e:31:26:79', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.51'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:48:26.464638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 25cba434-73ae-44ab-aa76-d477a015b1c7 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:48:26.464956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 25cba434-73ae-44ab-aa76-d477a015b1c7 updated. Details: {'device': '25cba434-73ae-44ab-aa76-d477a015b1c7', 'device_id': '5405c7e9-ad50-4474-b96c-4853d3358e50', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '25cba434-73ae-44ab-aa76-d477a015b1c7', 'mac_address': 'fa:16:3e:31:26:79', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.51'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:48:26.465904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-25cba434-73, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:26.466316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-25cba434-73, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:26.466702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-25cba434-73, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:26.467131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:48:26.467976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-25cba434-73, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:48:26.468603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:48:26.470571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ec02,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:26.470906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:21 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.008 Oct 09 00:48:26.471239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:48:26.472049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:48:26.473143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:48:26.473422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:48:26.475229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:48:26.520698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7094fbf-e347-4a56-b77d-148492b0af10]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:48:26.521306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:21 - agent port security group processed in 0.058 Oct 09 00:48:26.521893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 25cba434-73ae-44ab-aa76-d477a015b1c7 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:48:26.655259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['25cba434-73ae-44ab-aa76-d477a015b1c7'] and devices down [] completed. Oct 09 00:48:26.655576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:21 - ports processed. Elapsed:0.199 Oct 09 00:48:26.655959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:21 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.200 Oct 09 00:48:28.457943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:22 started Oct 09 00:48:28.463254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=783000000,duration_sec=50,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:28.464083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:28.465587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:22 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 00:48:30.459673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:23 started Oct 09 00:48:30.462867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=783000000,duration_sec=52,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:30.463419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:30.463863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:23 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:32.461221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:24 started Oct 09 00:48:32.465237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=785000000,duration_sec=54,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:32.465902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:32.466436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:24 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:48:34.462209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:25 started Oct 09 00:48:34.466191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=786000000,duration_sec=56,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:34.467280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:34.467889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:25 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:48:36.463493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:26 started Oct 09 00:48:36.465893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=787000000,duration_sec=58,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:36.466454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:36.466808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:26 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:48:38.465201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:27 started Oct 09 00:48:38.468039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=789000000,duration_sec=60,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:38.468585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:38.468931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:27 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:40.467016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:28 started Oct 09 00:48:40.473376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=792000000,duration_sec=62,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:40.474225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:40.474865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:28 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 00:48:42.468600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:29 started Oct 09 00:48:42.472235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=793000000,duration_sec=64,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:42.473422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:42.474069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:29 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:48:44.469363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:30 started Oct 09 00:48:44.472185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=793000000,duration_sec=66,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:44.472822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:44.473247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:30 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:46.470751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:31 started Oct 09 00:48:46.476297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=796000000,duration_sec=68,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:46.477279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:46.478095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:31 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 00:48:48.472136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:32 started Oct 09 00:48:48.475434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=796000000,duration_sec=70,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:48.476049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:48.476464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:32 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:50.474036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:33 started Oct 09 00:48:50.477116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=797000000,duration_sec=72,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:50.477983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:50.478497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:33 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:48:52.475556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:34 started Oct 09 00:48:52.479267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=800000000,duration_sec=74,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:52.480101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:52.480829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:34 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:48:54.476516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:35 started Oct 09 00:48:54.480532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=801000000,duration_sec=76,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:54.481392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:54.482076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:35 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:48:56.478148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:36 started Oct 09 00:48:56.480660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=802000000,duration_sec=78,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:56.481304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:56.481609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:36 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:48:58.479833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:37 started Oct 09 00:48:58.482245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=803000000,duration_sec=80,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:48:58.482856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:48:58.483210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:37 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:00.481368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:38 started Oct 09 00:49:00.483959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=805000000,duration_sec=82,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:00.484528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:00.484887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:38 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:02.482930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:39 started Oct 09 00:49:02.485556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=806000000,duration_sec=84,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:02.486172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:02.486528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:39 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:04.483580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:40 started Oct 09 00:49:04.486143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=807000000,duration_sec=86,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:04.486689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:04.487052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:40 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:06.484731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:41 started Oct 09 00:49:06.488140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=809000000,duration_sec=88,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:06.488707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:06.489147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:41 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:49:08.485469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:42 started Oct 09 00:49:08.488021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=809000000,duration_sec=90,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:08.488576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:08.488928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:42 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:10.488141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:43 started Oct 09 00:49:10.490735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=812000000,duration_sec=92,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:10.491322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:10.491732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:43 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:12.492154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:44 started Oct 09 00:49:12.494637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=815000000,duration_sec=94,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:12.495269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:12.495716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:44 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:14.492751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:45 started Oct 09 00:49:14.495161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=816000000,duration_sec=96,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:14.495819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:14.496423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:45 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:16.494399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:46 started Oct 09 00:49:16.497064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=818000000,duration_sec=98,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:16.497647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:16.498022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:46 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:18.495299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:47 started Oct 09 00:49:18.497917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=819000000,duration_sec=100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:18.498477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:18.498824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:47 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:20.496634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:48 started Oct 09 00:49:20.499249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=820000000,duration_sec=102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:20.499829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:20.500180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:48 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:22.497702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:49 started Oct 09 00:49:22.502823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=822000000,duration_sec=104,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:22.503399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:22.503804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:49 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:49:24.498477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:50 started Oct 09 00:49:24.501947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=822000000,duration_sec=106,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:24.502515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:24.502872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:50 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:49:26.499989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:51 started Oct 09 00:49:26.502370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=823000000,duration_sec=108,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:26.502915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:26.503265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:51 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:49:28.501484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:52 started Oct 09 00:49:28.504072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=825000000,duration_sec=110,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:28.504626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:28.504922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:52 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:30.503060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:53 started Oct 09 00:49:30.505580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=827000000,duration_sec=112,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:30.506131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:30.506482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:53 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:32.503971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:54 started Oct 09 00:49:32.506339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=827000000,duration_sec=114,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:32.506901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:32.507253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:54 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:49:34.505206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:55 started Oct 09 00:49:34.507451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=828000000,duration_sec=116,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:34.508034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:34.508388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:55 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:49:36.506827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:56 started Oct 09 00:49:36.509507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=830000000,duration_sec=118,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:36.510089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:36.510438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:56 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:38.507880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:57 started Oct 09 00:49:38.510221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=831000000,duration_sec=120,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:38.510765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:38.511139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:57 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:49:40.508820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:58 started Oct 09 00:49:40.511194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=832000000,duration_sec=122,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:40.511784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:40.512135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:58 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:49:42.510006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:59 started Oct 09 00:49:42.512426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=833000000,duration_sec=124,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:42.512985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:42.513336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:59 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:49:44.510515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:60 started Oct 09 00:49:44.512849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=834000000,duration_sec=126,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:44.513414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:44.514318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:60 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:49:46.512040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:61 started Oct 09 00:49:46.514454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=835000000,duration_sec=128,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:46.515007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:46.515353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:61 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:48.512834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:62 started Oct 09 00:49:48.515197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=836000000,duration_sec=130,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:48.515804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:48.516150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:62 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:50.514254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:63 started Oct 09 00:49:50.516943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=838000000,duration_sec=132,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:50.517514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:50.517864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:63 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:52.516266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:64 started Oct 09 00:49:52.518386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=839000000,duration_sec=134,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:52.519021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:52.519355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:64 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:54.516335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:65 started Oct 09 00:49:54.518669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=840000000,duration_sec=136,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:54.519264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:54.519645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:65 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:56.517811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:66 started Oct 09 00:49:56.520315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=841000000,duration_sec=138,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:56.520913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:56.521295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:66 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:49:56.673802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8196b412-9c84-4f16-ad3b-fe1104f9c4eb admin admin] Resource Subnet 50c3af93-7cea-4a3f-ac83-5f6ed98079bb updated (revision_number 0->1). Old fields: {'dns_nameservers': []} New fields: {'dns_nameservers': [DNSNameServer(address='8.8.8.8',order=0,subnet_id=50c3af93-7cea-4a3f-ac83-5f6ed98079bb), DNSNameServer(address='8.8.4.4',order=1,subnet_id=50c3af93-7cea-4a3f-ac83-5f6ed98079bb)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:49:56.674542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8196b412-9c84-4f16-ad3b-fe1104f9c4eb admin admin] Publish callbacks [] for Subnet (50c3af93-7cea-4a3f-ac83-5f6ed98079bb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:49:58.519049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:67 started Oct 09 00:49:58.521528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=842000000,duration_sec=140,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:49:58.522087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:49:58.522447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:67 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:00.519878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:68 started Oct 09 00:50:00.522443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=843000000,duration_sec=142,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:00.522994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:00.523372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:68 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:02.521633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:69 started Oct 09 00:50:02.524044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=845000000,duration_sec=144,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:02.524611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:02.524967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:69 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:04.522669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:70 started Oct 09 00:50:04.525501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=846000000,duration_sec=146,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:04.526058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:04.526416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:70 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:06.524141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:71 started Oct 09 00:50:06.526531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=847000000,duration_sec=148,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:06.527125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:06.527480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:71 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:08.524983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:72 started Oct 09 00:50:08.527379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=848000000,duration_sec=150,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:08.527980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:08.528344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:72 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:10.526473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:73 started Oct 09 00:50:10.529249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=850000000,duration_sec=152,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:10.529801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:10.530167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:73 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:12.528114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:74 started Oct 09 00:50:12.530469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=851000000,duration_sec=154,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:12.531043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:12.531390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:74 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:50:14.529646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:75 started Oct 09 00:50:14.532137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=853000000,duration_sec=156,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:14.532893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:14.533246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:75 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:16.530745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:76 started Oct 09 00:50:16.533293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=854000000,duration_sec=158,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:16.534032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:16.534425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:76 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:18.532194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:77 started Oct 09 00:50:18.534688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=856000000,duration_sec=160,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:18.535813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:18.536204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:77 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:20.533874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:78 started Oct 09 00:50:20.536895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=858000000,duration_sec=162,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:20.537476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:20.537822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:78 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:22.534849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:79 started Oct 09 00:50:22.537416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=858000000,duration_sec=164,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:22.537956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:22.538307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:79 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:24.535290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:80 started Oct 09 00:50:24.537804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=859000000,duration_sec=166,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:24.538568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:24.538917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:80 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:26.536141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:81 started Oct 09 00:50:26.538846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=859000000,duration_sec=168,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:26.539403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:26.539786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:81 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:28.537457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:82 started Oct 09 00:50:28.540276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=861000000,duration_sec=170,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:28.540836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:28.541190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:82 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:30.538267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:83 started Oct 09 00:50:30.540638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=862000000,duration_sec=172,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:30.541210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:30.541557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:83 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:50:32.539505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:84 started Oct 09 00:50:32.541853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=863000000,duration_sec=174,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:32.542397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:32.542750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:84 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:50:34.540569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:85 started Oct 09 00:50:34.543064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=864000000,duration_sec=176,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:34.543641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:34.543994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:85 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:36.541473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:86 started Oct 09 00:50:36.544216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=865000000,duration_sec=178,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:36.544782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:36.545129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:86 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:38.542539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:87 started Oct 09 00:50:38.544940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=866000000,duration_sec=180,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:38.545489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:38.545837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:87 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:50:40.543346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:88 started Oct 09 00:50:40.545718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=867000000,duration_sec=182,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:40.546771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:40.547121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:88 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:42.544133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:89 started Oct 09 00:50:42.547173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=867000000,duration_sec=184,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:42.547756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:42.548115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:89 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:44.545595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:90 started Oct 09 00:50:44.548183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=869000000,duration_sec=186,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:44.548738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:44.549091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:90 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:46.546474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:91 started Oct 09 00:50:46.548910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=870000000,duration_sec=188,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:46.549462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:46.549811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:91 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:48.547898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:92 started Oct 09 00:50:48.550382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=871000000,duration_sec=190,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:48.550958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:48.551340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:92 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:50.549092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:93 started Oct 09 00:50:50.551517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=872000000,duration_sec=192,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:50.552093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:50.552442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:93 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:52.550026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:94 started Oct 09 00:50:52.552386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=873000000,duration_sec=194,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:52.552954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:52.553299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:94 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:50:54.551183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:95 started Oct 09 00:50:54.558037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=875000000,duration_sec=196,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:54.559139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:54.559460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:95 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 00:50:56.478366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-82f4e284-ad4d-420f-9632-0605ee76f48c admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:50:56Z,description='',dns_domain=None,id=d06c7078-5fd3-49c5-a343-f0fce7616611,mtu=1500,name='shared',project_id='34e0fbee16724df3abcac7131a4822aa',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(d06c7078-5fd3-49c5-a343-f0fce7616611),segments=[NetworkSegment(e013aba5-13d0-409b-8810-bf9ea4c8b0d4)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:50:56Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:50:56.479093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-82f4e284-ad4d-420f-9632-0605ee76f48c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (d06c7078-5fd3-49c5-a343-f0fce7616611), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:50:56.552462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:96 started Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-82f4e284-ad4d-420f-9632-0605ee76f48c admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d06c7078-5fd3-49c5-a343-f0fce7616611 with segmentation id not found. Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:50:56.555730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:50:56.556821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:50:56.556821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:50:56.556821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:50:56.556821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d06c7078-5fd3-49c5-a343-f0fce7616611 with segmentation id not found. Oct 09 00:50:56.556821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:50:56.557871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=876000000,duration_sec=198,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:56.559083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:56.559440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:96 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 00:50:58.553557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:97 started Oct 09 00:50:58.556295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=877000000,duration_sec=200,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:50:58.556854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:50:58.557204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:97 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:50:59.705277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-56f7a6ff-5ed1-4b67-8ffb-0f9fa8375d28 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(1cd3c716-3460-480e-9b78-76260bd69c18)],cidr=192.168.233.0/24,created_at=2022-10-09T00:50:59Z,description='shared-subnet',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=192.168.233.1,host_routes=[],id=ea6cbc4b-737f-4e15-a67b-8c9b309ac29b,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='shared-subnet',network_id=d06c7078-5fd3-49c5-a343-f0fce7616611,project_id='34e0fbee16724df3abcac7131a4822aa',revision_number=0,segment_id=,service_types=[],shared=True,subnetpool_id=,updated_at=2022-10-09T00:50:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:50:59.705906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-56f7a6ff-5ed1-4b67-8ffb-0f9fa8375d28 admin admin] Publish callbacks [] for Subnet (ea6cbc4b-737f-4e15-a67b-8c9b309ac29b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:51:00.312748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1102848-7508-480b-8b40-c5d59aed740f None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:50:59Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d06c7078-5fd3-49c5-a343-f0fce7616611',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a976c1aa-1777-4766-a2b3-029491ee66f7,mac_address=fa:16:3e:2d:ab:cd,name='',network_id=d06c7078-5fd3-49c5-a343-f0fce7616611,numa_affinity_policy=,project_id='34e0fbee16724df3abcac7131a4822aa',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a976c1aa-1777-4766-a2b3-029491ee66f7),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:51:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:51:00.313492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1102848-7508-480b-8b40-c5d59aed740f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a976c1aa-1777-4766-a2b3-029491ee66f7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:51:00.541074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1102848-7508-480b-8b40-c5d59aed740f None None] Resource Port a976c1aa-1777-4766-a2b3-029491ee66f7 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a976c1aa-1777-4766-a2b3-029491ee66f7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a976c1aa-1777-4766-a2b3-029491ee66f7,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a976c1aa-1777-4766-a2b3-029491ee66f7,segment=NetworkSegment(e013aba5-13d0-409b-8810-bf9ea4c8b0d4),segment_id=e013aba5-13d0-409b-8810-bf9ea4c8b0d4)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:51:00.541445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1102848-7508-480b-8b40-c5d59aed740f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a976c1aa-1777-4766-a2b3-029491ee66f7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:51:00.554287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:98 started Oct 09 00:51:00.557286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=878000000,duration_sec=202,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:00.558526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:00.559049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:98 - starting polling. Elapsed:0.005 Oct 09 00:51:00.560938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:51:00.562250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:98 - port information retrieved. Elapsed:0.008 Oct 09 00:51:00.562603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:98 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 00:51:00.614301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["554dccf7-b138-4539-9848-4f1970fdfc7d","insert","tapa976c1aa-17",["set",[]],["map",[["attached-mac","fa:16:3e:2d:ab:cd"],["iface-id","a976c1aa-1777-4766-a2b3-029491ee66f7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:51:00.631909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["554dccf7-b138-4539-9848-4f1970fdfc7d","old",null,["set",[]],null],["","new","tapa976c1aa-17",5,["map",[["attached-mac","fa:16:3e:2d:ab:cd"],["iface-id","a976c1aa-1777-4766-a2b3-029491ee66f7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:51:01.608082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ca0c8b18-868c-4ae0-9f33-34036ae05f56 None None] Resource Port a976c1aa-1777-4766-a2b3-029491ee66f7 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:51:01.608732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ca0c8b18-868c-4ae0-9f33-34036ae05f56 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a976c1aa-1777-4766-a2b3-029491ee66f7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:51:02.555170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:99 started Oct 09 00:51:02.558407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ec9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=879000000,duration_sec=204,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:02.559004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:02.559500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:99 - starting polling. Elapsed:0.005 Oct 09 00:51:02.560782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:51:02.562098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:99 - port information retrieved. Elapsed:0.007 Oct 09 00:51:02.562425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a976c1aa-1777-4766-a2b3-029491ee66f7', '6fc925b8-cc04-47c9-908d-92ab057747b2'}, 'added': {'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'removed': set(), 'updated': {'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:51:02.562980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d06c7078-5fd3-49c5-a343-f0fce7616611', 'network_id': 'd06c7078-5fd3-49c5-a343-f0fce7616611', 'port_id': 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'mac_address': 'fa:16:3e:2d:ab:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 674, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ea6cbc4b-737f-4e15-a67b-8c9b309ac29b', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:51:02.564273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: a976c1aa-1777-4766-a2b3-029491ee66f7 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:51:02.564617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port a976c1aa-1777-4766-a2b3-029491ee66f7 updated. Details: {'device': 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d06c7078-5fd3-49c5-a343-f0fce7616611', 'network_id': 'd06c7078-5fd3-49c5-a343-f0fce7616611', 'port_id': 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'mac_address': 'fa:16:3e:2d:ab:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 674, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ea6cbc4b-737f-4e15-a67b-8c9b309ac29b', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:51:02.564957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 3 as local vlan for net-id=d06c7078-5fd3-49c5-a343-f0fce7616611, seg-id=674 Oct 09 00:51:02.567480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da1825,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4770), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4099}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:02.569872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363eca0,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4099)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4770}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:02.570811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapa976c1aa-17, col_values=(('tag', 3),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:51:02.571228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapa976c1aa-17, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:51:02.571896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapa976c1aa-17, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:51:02.577116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapa976c1aa-17, col_values=(('other_config', {'net_uuid': 'd06c7078-5fd3-49c5-a343-f0fce7616611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '3', 'segmentation_id': '674'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:51:02.583828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363eca2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:02.584176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:99 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.021 Oct 09 00:51:02.584527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:51:02.584825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'a976c1aa-1777-4766-a2b3-029491ee66f7'} Oct 09 00:51:02.585953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:51:02.586236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:51:02.588337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:51:02.625205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[43120411-dc69-4f65-a5a6-bde2c6c408a6]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:51:02.625838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:99 - agent port security group processed in 0.063 Oct 09 00:51:02.626403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for a976c1aa-1777-4766-a2b3-029491ee66f7 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:51:02.753265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['a976c1aa-1777-4766-a2b3-029491ee66f7'] and devices down [] completed. Oct 09 00:51:02.753583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:99 - ports processed. Elapsed:0.199 Oct 09 00:51:02.753917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:99 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.199 Oct 09 00:51:04.555690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:100 started Oct 09 00:51:04.559008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eca4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=879000000,duration_sec=206,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:04.559605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:04.559957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:100 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:06.557581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:101 started Oct 09 00:51:06.560192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eca6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=881000000,duration_sec=208,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:06.560763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:06.561112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:101 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:08.557883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:102 started Oct 09 00:51:08.560241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eca8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=881000000,duration_sec=210,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:08.560815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:08.561173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:102 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:10.558885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:103 started Oct 09 00:51:10.561279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecaa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=882000000,duration_sec=212,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:10.561852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:10.562200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:103 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:12.560193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:104 started Oct 09 00:51:12.562859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=884000000,duration_sec=214,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:12.563466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:12.563844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:104 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:14.560717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:105 started Oct 09 00:51:14.563079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=884000000,duration_sec=216,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:14.563702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:14.564050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:105 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:16.561825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:106 started Oct 09 00:51:16.564233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=885000000,duration_sec=218,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:16.564786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:16.565138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:106 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:18.563279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:107 started Oct 09 00:51:18.566149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=887000000,duration_sec=220,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:18.566734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:18.567093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:107 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:20.564592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:108 started Oct 09 00:51:20.567393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=888000000,duration_sec=222,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:20.568006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:20.568358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:108 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:22.565568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:109 started Oct 09 00:51:22.568577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=889000000,duration_sec=224,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:22.569398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:22.569762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:109 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:24.566556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:110 started Oct 09 00:51:24.568952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=890000000,duration_sec=226,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:24.569510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:24.570511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:110 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:26.567092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:111 started Oct 09 00:51:26.569722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=890000000,duration_sec=228,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:26.570301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:26.570650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:111 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:28.568377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:112 started Oct 09 00:51:28.570743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=892000000,duration_sec=230,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:28.571294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:28.571680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:112 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:30.569868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:113 started Oct 09 00:51:30.572275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=893000000,duration_sec=232,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:30.572913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:30.573294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:113 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:32.570420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:114 started Oct 09 00:51:32.572782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=894000000,duration_sec=234,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:32.573364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:32.573743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:114 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:34.571056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:115 started Oct 09 00:51:34.573439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=894000000,duration_sec=236,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:34.573996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:34.574343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:115 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:36.572986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:116 started Oct 09 00:51:36.575347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=896000000,duration_sec=238,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:36.575929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:36.576282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:116 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:38.574441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:117 started Oct 09 00:51:38.577343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=898000000,duration_sec=240,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:38.577893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:38.578242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:117 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:40.575668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:118 started Oct 09 00:51:40.578199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=899000000,duration_sec=242,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:40.578776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:40.579208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:118 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:42.576758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:119 started Oct 09 00:51:42.578995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=900000000,duration_sec=244,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:42.579553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:42.579940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:119 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:44.577258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:120 started Oct 09 00:51:44.579718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eccc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=901000000,duration_sec=246,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:44.580301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:44.580672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:120 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:46.578862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:121 started Oct 09 00:51:46.581342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=902000000,duration_sec=248,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:46.581885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:46.582230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:121 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:48.579843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:122 started Oct 09 00:51:48.582812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=903000000,duration_sec=250,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:48.583400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:48.583787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:122 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:50.581208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:123 started Oct 09 00:51:50.584183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=905000000,duration_sec=252,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:50.584740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:50.585088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:123 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:52.582436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:124 started Oct 09 00:51:52.584720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=906000000,duration_sec=254,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:52.585266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:52.585636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:124 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:54.583715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:125 started Oct 09 00:51:54.586077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=907000000,duration_sec=256,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:54.586635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:54.586984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:125 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:51:56.584632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:126 started Oct 09 00:51:56.587090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=908000000,duration_sec=258,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:56.587672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:56.588027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:126 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:51:58.585890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:127 started Oct 09 00:51:58.588361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=909000000,duration_sec=260,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:51:58.588906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:51:58.589252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:127 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:00.586749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:128 started Oct 09 00:52:00.589241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecdc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=910000000,duration_sec=262,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:00.589865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:00.590213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:128 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:02.587924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:129 started Oct 09 00:52:02.590206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=911000000,duration_sec=264,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:02.590759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:02.591105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:129 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:04.588840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:130 started Oct 09 00:52:04.591462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ece0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=912000000,duration_sec=266,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:04.592105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:04.592462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:130 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:06.590012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:131 started Oct 09 00:52:06.592575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ece2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=913000000,duration_sec=268,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:06.593130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:06.593483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:131 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:08.591221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:132 started Oct 09 00:52:08.593740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ece4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=915000000,duration_sec=270,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:08.594316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:08.594666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:132 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:10.592882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:133 started Oct 09 00:52:10.595430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ece6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=916000000,duration_sec=272,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:10.596079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:10.596464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:133 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:12.593980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:134 started Oct 09 00:52:12.596377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ece8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=917000000,duration_sec=274,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:12.596934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:12.597284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:134 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:14.595724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:135 started Oct 09 00:52:14.598659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=920000000,duration_sec=276,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:14.599259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:14.599675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:135 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:16.597168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:136 started Oct 09 00:52:16.599514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=920000000,duration_sec=278,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:16.600097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:16.600450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:136 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:18.598836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:137 started Oct 09 00:52:18.601297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=922000000,duration_sec=280,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:18.601844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:18.602196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:137 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:20.600157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:138 started Oct 09 00:52:20.602836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecf0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=923000000,duration_sec=282,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:20.603405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:20.603789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:138 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:21.629561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:52:21Z,description='Default security group',id=309a0044-6ece-4442-a7bc-2606dec19d5e,is_default=True,name='default',project_id='96f6edbeffac4880b3ef70141f0668e7',revision_number=1,rules=[SecurityGroupRule(3f3edeb0-2390-4a87-83eb-a5c13f76857f),SecurityGroupRule(5147963d-b8b2-46e2-bc72-25d8950878db),SecurityGroupRule(586a68fe-551c-4dd2-ab24-054b47346ef9),SecurityGroupRule(b82f2efa-d32c-47bb-b09f-b443a3f14f51)],shared=False,stateful=True,updated_at=2022-10-09T00:52:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:52:21.630244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (309a0044-6ece-4442-a7bc-2606dec19d5e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.630713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:52:21Z,description=,direction='egress',ethertype='IPv6',id=3f3edeb0-2390-4a87-83eb-a5c13f76857f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='96f6edbeffac4880b3ef70141f0668e7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=309a0044-6ece-4442-a7bc-2606dec19d5e,updated_at=2022-10-09T00:52:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:52:21.631138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3f3edeb0-2390-4a87-83eb-a5c13f76857f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.631534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Security group rule updated ['309a0044-6ece-4442-a7bc-2606dec19d5e'] Oct 09 00:52:21.632319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:52:21Z,description=,direction='ingress',ethertype='IPv6',id=5147963d-b8b2-46e2-bc72-25d8950878db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='96f6edbeffac4880b3ef70141f0668e7',protocol=,remote_address_group_id=,remote_group_id=309a0044-6ece-4442-a7bc-2606dec19d5e,remote_ip_prefix=,revision_number=0,security_group_id=309a0044-6ece-4442-a7bc-2606dec19d5e,updated_at=2022-10-09T00:52:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:52:21.632729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5147963d-b8b2-46e2-bc72-25d8950878db), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.633134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Security group rule updated ['309a0044-6ece-4442-a7bc-2606dec19d5e'] Oct 09 00:52:21.633843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:52:21Z,description=,direction='egress',ethertype='IPv4',id=586a68fe-551c-4dd2-ab24-054b47346ef9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='96f6edbeffac4880b3ef70141f0668e7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=309a0044-6ece-4442-a7bc-2606dec19d5e,updated_at=2022-10-09T00:52:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:52:21.634280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (586a68fe-551c-4dd2-ab24-054b47346ef9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.634687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Security group rule updated ['309a0044-6ece-4442-a7bc-2606dec19d5e'] Oct 09 00:52:21.635394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:52:21Z,description=,direction='ingress',ethertype='IPv4',id=b82f2efa-d32c-47bb-b09f-b443a3f14f51,normalized_cidr=None,port_range_max=,port_range_min=,project_id='96f6edbeffac4880b3ef70141f0668e7',protocol=,remote_address_group_id=,remote_group_id=309a0044-6ece-4442-a7bc-2606dec19d5e,remote_ip_prefix=,revision_number=0,security_group_id=309a0044-6ece-4442-a7bc-2606dec19d5e,updated_at=2022-10-09T00:52:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:52:21.635841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b82f2efa-d32c-47bb-b09f-b443a3f14f51), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.636227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-60f367e2-6e4e-4e89-907c-2c572cdad0f8 admin admin] Security group rule updated ['309a0044-6ece-4442-a7bc-2606dec19d5e'] Oct 09 00:52:21.882523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Resource SecurityGroup deleted: 309a0044-6ece-4442-a7bc-2606dec19d5e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:52:21.882970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (309a0044-6ece-4442-a7bc-2606dec19d5e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.883525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('309a0044-6ece-4442-a7bc-2606dec19d5e',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:52:21.903179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('309a0044-6ece-4442-a7bc-2606dec19d5e',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:52:21.903564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Resource SecurityGroupRule deleted: 3f3edeb0-2390-4a87-83eb-a5c13f76857f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:52:21.903966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3f3edeb0-2390-4a87-83eb-a5c13f76857f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.904297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Security group rule updated ['309a0044-6ece-4442-a7bc-2606dec19d5e'] Oct 09 00:52:21.904705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Resource SecurityGroupRule deleted: 5147963d-b8b2-46e2-bc72-25d8950878db {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:52:21.905046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5147963d-b8b2-46e2-bc72-25d8950878db), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.905361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Security group rule updated ['309a0044-6ece-4442-a7bc-2606dec19d5e'] Oct 09 00:52:21.905992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Resource SecurityGroupRule deleted: 586a68fe-551c-4dd2-ab24-054b47346ef9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:52:21.906327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (586a68fe-551c-4dd2-ab24-054b47346ef9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.906640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Security group rule updated ['309a0044-6ece-4442-a7bc-2606dec19d5e'] Oct 09 00:52:21.906997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Resource SecurityGroupRule deleted: b82f2efa-d32c-47bb-b09f-b443a3f14f51 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:52:21.907331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b82f2efa-d32c-47bb-b09f-b443a3f14f51), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:52:21.907660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ed42ec84-ee84-4cc4-80ba-d5f687203afb admin admin] Security group rule updated ['309a0044-6ece-4442-a7bc-2606dec19d5e'] Oct 09 00:52:22.600735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:139 started Oct 09 00:52:22.602979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecf2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=924000000,duration_sec=284,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:22.603530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:22.603903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:139 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:24.601653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:140 started Oct 09 00:52:24.604040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecf4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=925000000,duration_sec=286,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:24.604594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:24.604945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:140 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:26.603400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:141 started Oct 09 00:52:26.606125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecf6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=927000000,duration_sec=288,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:26.606683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:26.607040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:141 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:28.604467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:142 started Oct 09 00:52:28.607268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecf8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=928000000,duration_sec=290,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:28.607865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:28.608222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:142 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:30.605618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:143 started Oct 09 00:52:30.607996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecfa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=929000000,duration_sec=292,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:30.608557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:30.608909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:143 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:32.606591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:144 started Oct 09 00:52:32.608902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecfc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=930000000,duration_sec=294,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:32.609487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:32.609839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:144 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:34.608047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:145 started Oct 09 00:52:34.611010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ecfe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=931000000,duration_sec=296,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:34.611612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:34.611983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:145 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:36.609413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:146 started Oct 09 00:52:36.612278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=933000000,duration_sec=298,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:36.612837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:36.613191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:146 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:38.610597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:147 started Oct 09 00:52:38.613490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=934000000,duration_sec=300,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:38.614076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:38.614423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:147 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:40.611440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:148 started Oct 09 00:52:40.613813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=935000000,duration_sec=302,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:40.614402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:40.614758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:148 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:42.612503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:149 started Oct 09 00:52:42.614711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=936000000,duration_sec=304,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:42.615265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:42.615651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:149 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:44.613533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:150 started Oct 09 00:52:44.615905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=937000000,duration_sec=306,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:44.616473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:44.616853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:150 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:46.614468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:151 started Oct 09 00:52:46.616865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=938000000,duration_sec=308,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:46.617433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:46.617789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:151 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:48.615645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:152 started Oct 09 00:52:48.618213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=939000000,duration_sec=310,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:48.618772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:48.619122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:152 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:50.616510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:153 started Oct 09 00:52:50.618832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=940000000,duration_sec=312,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:50.619385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:50.619778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:153 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:52.617262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:154 started Oct 09 00:52:52.619464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=940000000,duration_sec=314,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:52.620046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:52.620420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:154 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:52:54.617765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:155 started Oct 09 00:52:54.620121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=941000000,duration_sec=316,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:54.620682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:54.621031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:155 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:56.619121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:156 started Oct 09 00:52:56.621482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=942000000,duration_sec=318,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:56.622045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:56.622387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:156 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:52:58.620294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:157 started Oct 09 00:52:58.622625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=944000000,duration_sec=320,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:52:58.623174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:52:58.623518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:157 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:00.621495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:158 started Oct 09 00:53:00.623811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=945000000,duration_sec=322,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:00.624393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:00.624740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:158 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:02.622847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:159 started Oct 09 00:53:02.625068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=946000000,duration_sec=324,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:02.625623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:02.625968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:159 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:04.623451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:160 started Oct 09 00:53:04.625793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=947000000,duration_sec=326,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:04.626863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:04.627207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:160 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:06.624649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:161 started Oct 09 00:53:06.627436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=948000000,duration_sec=328,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:06.628078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:06.628423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:161 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:08.625907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:162 started Oct 09 00:53:08.629246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=950000000,duration_sec=330,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:08.629809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:08.630169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:162 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:10.627225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:163 started Oct 09 00:53:10.629732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=951000000,duration_sec=332,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:10.630296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:10.630668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:163 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:12.627804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:164 started Oct 09 00:53:12.630074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=951000000,duration_sec=334,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:12.630633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:12.630981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:164 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:14.629060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:165 started Oct 09 00:53:14.631399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=952000000,duration_sec=336,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:14.631982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:14.632334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:165 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:16.630359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:166 started Oct 09 00:53:16.632854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=954000000,duration_sec=338,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:16.633406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:16.633752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:166 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:18.631759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:167 started Oct 09 00:53:18.634135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=955000000,duration_sec=340,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:18.634692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:18.635041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:167 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:20.633106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:168 started Oct 09 00:53:20.635456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=956000000,duration_sec=342,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:20.636038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:20.636388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:168 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:22.633605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:169 started Oct 09 00:53:22.635818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=957000000,duration_sec=344,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:22.636372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:22.636718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:169 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:24.635071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:170 started Oct 09 00:53:24.637746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=958000000,duration_sec=346,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:24.638314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:24.638667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:170 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:26.635940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:171 started Oct 09 00:53:26.638262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=959000000,duration_sec=348,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:26.638837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:26.639171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:171 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:28.637056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:172 started Oct 09 00:53:28.639397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=960000000,duration_sec=350,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:28.639971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:28.640317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:172 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:30.637745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:173 started Oct 09 00:53:30.640091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=961000000,duration_sec=352,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:30.640646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:30.641088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:173 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:32.638826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:174 started Oct 09 00:53:32.641132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=962000000,duration_sec=354,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:32.641711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:32.642056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:174 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:34.640123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:175 started Oct 09 00:53:34.643033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=964000000,duration_sec=356,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:34.643615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:34.644009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:175 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:36.641413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:176 started Oct 09 00:53:36.643783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=965000000,duration_sec=358,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:36.644347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:36.644706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:176 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:38.642849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:177 started Oct 09 00:53:38.645215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=966000000,duration_sec=360,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:38.645809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:38.646162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:177 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:40.644110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:178 started Oct 09 00:53:40.646456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=967000000,duration_sec=362,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:40.647015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:40.647367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:178 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:42.645325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:179 started Oct 09 00:53:42.647544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=969000000,duration_sec=364,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:42.648169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:42.648517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:179 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:44.646324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:180 started Oct 09 00:53:44.648661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=970000000,duration_sec=366,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:44.649222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:44.649581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:180 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:46.647718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:181 started Oct 09 00:53:46.650060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=971000000,duration_sec=368,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:46.650613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:46.650958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:181 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:48.648362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:182 started Oct 09 00:53:48.650701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=972000000,duration_sec=370,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:48.651263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:48.651666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:182 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:50.649118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:183 started Oct 09 00:53:50.651437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=972000000,duration_sec=372,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:50.651998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:50.652401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:183 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:53:52.650358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:184 started Oct 09 00:53:52.652609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=974000000,duration_sec=374,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:52.653407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:52.653758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:184 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:54.651744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:185 started Oct 09 00:53:54.654344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=975000000,duration_sec=376,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:54.654899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:54.655253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:185 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:56.652662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:186 started Oct 09 00:53:56.655485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=976000000,duration_sec=378,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:56.656065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:56.656414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:186 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:53:58.653915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:187 started Oct 09 00:53:58.656352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=977000000,duration_sec=380,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:53:58.656911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:53:58.657264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:187 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:00.654910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:188 started Oct 09 00:54:00.657190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=978000000,duration_sec=382,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:00.657745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:00.658095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:188 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:02.656154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:189 started Oct 09 00:54:02.662440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=979000000,duration_sec=384,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:02.663004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:02.663353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:189 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 00:54:04.657029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:190 started Oct 09 00:54:04.660151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=980000000,duration_sec=386,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:04.661193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:04.661544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:190 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:54:06.658071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:191 started Oct 09 00:54:06.660316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=981000000,duration_sec=388,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:06.660871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:06.661217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:191 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:08.659085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:192 started Oct 09 00:54:08.661492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=982000000,duration_sec=390,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:08.662044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:08.662395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:192 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:10.660139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:193 started Oct 09 00:54:10.662531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=983000000,duration_sec=392,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:10.663094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:10.663466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:193 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:12.661177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:194 started Oct 09 00:54:12.663544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=984000000,duration_sec=394,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:12.664132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:12.664505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:194 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:14.662387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:195 started Oct 09 00:54:14.664825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=986000000,duration_sec=396,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:14.665387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:14.665738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:195 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:16.663701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:196 started Oct 09 00:54:16.666064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=987000000,duration_sec=398,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:16.666615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:16.666967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:196 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:18.664985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:197 started Oct 09 00:54:18.667709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=988000000,duration_sec=400,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:18.668259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:18.668603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:197 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:20.666035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:198 started Oct 09 00:54:20.668368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=989000000,duration_sec=402,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:20.668947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:20.669297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:198 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:22.666504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:199 started Oct 09 00:54:22.668869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=990000000,duration_sec=404,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:22.669429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:22.669773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:199 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:24.667880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:200 started Oct 09 00:54:24.670184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=991000000,duration_sec=406,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:24.670742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:24.671091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:200 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:26.668647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:201 started Oct 09 00:54:26.670970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=992000000,duration_sec=408,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:26.671533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:26.671915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:201 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:28.669871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:202 started Oct 09 00:54:28.672242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=993000000,duration_sec=410,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:28.672797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:28.673146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:202 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:30.671246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:203 started Oct 09 00:54:30.673595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=995000000,duration_sec=412,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:30.674179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:30.674528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:203 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:32.671986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:204 started Oct 09 00:54:32.674744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=995000000,duration_sec=414,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:32.675320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:32.675764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:204 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:34.672849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:205 started Oct 09 00:54:34.676139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=996000000,duration_sec=416,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:34.676705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:34.677057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:205 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:36.673430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:206 started Oct 09 00:54:36.676315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=997000000,duration_sec=418,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:36.676870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:36.677219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:206 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:38.674674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:207 started Oct 09 00:54:38.677011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=998000000,duration_sec=420,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:38.677567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:38.677914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:207 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:40.675155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:208 started Oct 09 00:54:40.677523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=998000000,duration_sec=422,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:40.678087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:40.678439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:208 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:42.676606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:209 started Oct 09 00:54:42.678819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=0,duration_sec=425,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:42.679380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:42.679783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:209 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:44.678119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:210 started Oct 09 00:54:44.680512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=1000000,duration_sec=427,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:44.681072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:44.681421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:210 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:46.679245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:211 started Oct 09 00:54:46.681559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=3000000,duration_sec=429,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:46.682110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:46.682453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:211 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:48.680097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:212 started Oct 09 00:54:48.682459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=3000000,duration_sec=431,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:48.682989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:48.683342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:212 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:50.681559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:213 started Oct 09 00:54:50.683938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=5000000,duration_sec=433,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:50.684495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:50.684846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:213 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:52.682761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:214 started Oct 09 00:54:52.685249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=6000000,duration_sec=435,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:52.685797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:52.686143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:214 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:54.683972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:215 started Oct 09 00:54:54.686370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=7000000,duration_sec=437,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:54.686934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:54.687288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:215 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:54:56.685392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:216 started Oct 09 00:54:56.687726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=9000000,duration_sec=439,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:56.688302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:56.688648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:216 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:54:58.686632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:217 started Oct 09 00:54:58.689077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=10000000,duration_sec=441,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:54:58.690177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:54:58.690536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:217 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:00.687526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:218 started Oct 09 00:55:00.690634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=11000000,duration_sec=443,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:00.691206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:00.691562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:218 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:02.688375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:219 started Oct 09 00:55:02.691104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=12000000,duration_sec=445,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:02.691683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:02.692038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:219 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:04.689867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:220 started Oct 09 00:55:04.692271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=13000000,duration_sec=447,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:04.692840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:04.693196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:220 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:06.691398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:221 started Oct 09 00:55:06.694222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=15000000,duration_sec=449,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:06.694846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:06.695530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:221 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:08.692155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:222 started Oct 09 00:55:08.695148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=16000000,duration_sec=451,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:08.695821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:08.696265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:222 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:10.693368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:223 started Oct 09 00:55:10.695758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=17000000,duration_sec=453,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:10.696318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:10.696670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:223 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:12.694615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:224 started Oct 09 00:55:12.697039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=18000000,duration_sec=455,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:12.697654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:12.698010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:224 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:14.695100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:225 started Oct 09 00:55:14.697512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ed9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=18000000,duration_sec=457,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:14.698095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:14.698449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:225 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:16.696621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:226 started Oct 09 00:55:16.699022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eda0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=20000000,duration_sec=459,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:16.699624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:16.699994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:226 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:18.697250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:227 started Oct 09 00:55:18.699581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eda2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=21000000,duration_sec=461,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:18.700149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:18.700491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:227 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:55:20.698098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:228 started Oct 09 00:55:20.700569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eda4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=21000000,duration_sec=463,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:20.701121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:20.701471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:228 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:22.698858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:229 started Oct 09 00:55:22.701225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eda6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=22000000,duration_sec=465,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:22.701780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:22.702134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:229 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:55:24.700217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:230 started Oct 09 00:55:24.702569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eda8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=24000000,duration_sec=467,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:24.703170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:24.703522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:230 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:55:26.701103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:231 started Oct 09 00:55:26.703540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edaa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=24000000,duration_sec=469,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:26.704113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:26.704460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:231 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:28.702439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:232 started Oct 09 00:55:28.705427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=26000000,duration_sec=471,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:28.705978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:28.706326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:232 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:30.703170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:233 started Oct 09 00:55:30.706368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=26000000,duration_sec=473,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:30.706943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:30.707293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:233 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:32.704631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:234 started Oct 09 00:55:32.707751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=29000000,duration_sec=475,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:32.708306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:32.708660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:234 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:34.705680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:235 started Oct 09 00:55:34.708092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=29000000,duration_sec=477,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:34.708643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:34.709023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:235 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:55:36.707221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:236 started Oct 09 00:55:36.709747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=31000000,duration_sec=479,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:36.710318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:36.710662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:236 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:38.708756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:237 started Oct 09 00:55:38.711181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=32000000,duration_sec=481,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:38.711770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:38.712127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:237 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:40.710169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:238 started Oct 09 00:55:40.713040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=34000000,duration_sec=483,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:40.713593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:40.713943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:238 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:42.711151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:239 started Oct 09 00:55:42.713892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=35000000,duration_sec=485,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:42.714465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:42.714877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:239 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:55:44.712206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:240 started Oct 09 00:55:44.715484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=36000000,duration_sec=487,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:44.716256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:44.716675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:240 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:55:45.135677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:55:44Z,description='Default security group',id=8847f164-307d-42d0-9040-ccfe75a13f21,is_default=True,name='default',project_id='40e631c5e320489cac9cea85118c6263',revision_number=1,rules=[SecurityGroupRule(03c65f21-9eb3-42d2-92d0-d2737dd2bddb),SecurityGroupRule(3ec583f6-b8e4-4269-b5a8-3cb7963ee25b),SecurityGroupRule(9de8a4b9-819e-477d-9419-71820bf35d8c),SecurityGroupRule(d7fc850d-04c3-43a2-904f-5fb0709764b6)],shared=False,stateful=True,updated_at=2022-10-09T00:55:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:45.136149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (8847f164-307d-42d0-9040-ccfe75a13f21), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:45.137115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:45Z,description=,direction='egress',ethertype='IPv4',id=03c65f21-9eb3-42d2-92d0-d2737dd2bddb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8847f164-307d-42d0-9040-ccfe75a13f21,updated_at=2022-10-09T00:55:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:45.137585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (03c65f21-9eb3-42d2-92d0-d2737dd2bddb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:45.138290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Security group rule updated ['8847f164-307d-42d0-9040-ccfe75a13f21'] Oct 09 00:55:45.139166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:45Z,description=,direction='ingress',ethertype='IPv6',id=3ec583f6-b8e4-4269-b5a8-3cb7963ee25b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol=,remote_address_group_id=,remote_group_id=8847f164-307d-42d0-9040-ccfe75a13f21,remote_ip_prefix=,revision_number=0,security_group_id=8847f164-307d-42d0-9040-ccfe75a13f21,updated_at=2022-10-09T00:55:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:45.139649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3ec583f6-b8e4-4269-b5a8-3cb7963ee25b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:45.140294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Security group rule updated ['8847f164-307d-42d0-9040-ccfe75a13f21'] Oct 09 00:55:45.141507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:45Z,description=,direction='egress',ethertype='IPv6',id=9de8a4b9-819e-477d-9419-71820bf35d8c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8847f164-307d-42d0-9040-ccfe75a13f21,updated_at=2022-10-09T00:55:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:45.142149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9de8a4b9-819e-477d-9419-71820bf35d8c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:45.143219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Security group rule updated ['8847f164-307d-42d0-9040-ccfe75a13f21'] Oct 09 00:55:45.144669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:45Z,description=,direction='ingress',ethertype='IPv4',id=d7fc850d-04c3-43a2-904f-5fb0709764b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol=,remote_address_group_id=,remote_group_id=8847f164-307d-42d0-9040-ccfe75a13f21,remote_ip_prefix=,revision_number=0,security_group_id=8847f164-307d-42d0-9040-ccfe75a13f21,updated_at=2022-10-09T00:55:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:45.145562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d7fc850d-04c3-43a2-904f-5fb0709764b6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:45.146118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Security group rule updated ['8847f164-307d-42d0-9040-ccfe75a13f21'] Oct 09 00:55:45.283875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:55:45Z,description='',dns_domain=None,id=93a9ba3d-37f0-48ce-9786-b421e5404102,mtu=1500,name='tempest-AttachVolumeTestJSON-1991532309-network',project_id='40e631c5e320489cac9cea85118c6263',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(93a9ba3d-37f0-48ce-9786-b421e5404102),segments=[NetworkSegment(47eb43ca-62f0-426c-bb7d-8fbf6653ed4a)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:55:45Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:45.284335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (93a9ba3d-37f0-48ce-9786-b421e5404102), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-882853e8-573c-40f4-92df-6407875f06f7 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 93a9ba3d-37f0-48ce-9786-b421e5404102 with segmentation id not found. Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:55:45.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:55:45.364788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:55:45.364788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:55:45.364788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:55:45.364788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 93a9ba3d-37f0-48ce-9786-b421e5404102 with segmentation id not found. Oct 09 00:55:45.364788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:55:45.606719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7728eec7-78d3-466b-8d81-11226dbc0514 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(19e9c80e-4a16-4b34-afb2-382285fa6b58)],cidr=172.20.0.0/28,created_at=2022-10-09T00:55:45Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=9ba14a53-0198-4c1f-9001-da2b49d70087,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeTestJSON-1991532309-subnet',network_id=93a9ba3d-37f0-48ce-9786-b421e5404102,project_id='40e631c5e320489cac9cea85118c6263',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:55:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:45.607194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7728eec7-78d3-466b-8d81-11226dbc0514 admin admin] Publish callbacks [] for Subnet (9ba14a53-0198-4c1f-9001-da2b49d70087), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.325381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ebf87ac0-9757-49e8-8660-e39cb972267b None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:45Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93a9ba3d-37f0-48ce-9786-b421e5404102',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a12e3d11-0a2d-4089-8565-84afac1050b3,mac_address=fa:16:3e:2f:ce:5b,name='',network_id=93a9ba3d-37f0-48ce-9786-b421e5404102,numa_affinity_policy=,project_id='40e631c5e320489cac9cea85118c6263',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a12e3d11-0a2d-4089-8565-84afac1050b3),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:46.327408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ebf87ac0-9757-49e8-8660-e39cb972267b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a12e3d11-0a2d-4089-8565-84afac1050b3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.536536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:55:46Z,description='Default security group',id=5ca2704a-36a6-44be-843b-b3c729b1a9d0,is_default=True,name='default',project_id='88e7a07d04d74e739b7fa17f73018b64',revision_number=1,rules=[SecurityGroupRule(220b85ae-c348-4ce7-91f2-7d9e3a8464eb),SecurityGroupRule(73d76d4a-d37c-4021-b136-5edabdbf9c6e),SecurityGroupRule(7a6822e1-1f88-4c55-bfde-bcb9cab0674f),SecurityGroupRule(f186b8dd-6211-4f3f-8e1c-cb8a49bb29fd)],shared=False,stateful=True,updated_at=2022-10-09T00:55:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:46.536924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (5ca2704a-36a6-44be-843b-b3c729b1a9d0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.537549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:46Z,description=,direction='egress',ethertype='IPv6',id=220b85ae-c348-4ce7-91f2-7d9e3a8464eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88e7a07d04d74e739b7fa17f73018b64',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5ca2704a-36a6-44be-843b-b3c729b1a9d0,updated_at=2022-10-09T00:55:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:46.537900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (220b85ae-c348-4ce7-91f2-7d9e3a8464eb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.538416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Security group rule updated ['5ca2704a-36a6-44be-843b-b3c729b1a9d0'] Oct 09 00:55:46.539257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:46Z,description=,direction='ingress',ethertype='IPv4',id=73d76d4a-d37c-4021-b136-5edabdbf9c6e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88e7a07d04d74e739b7fa17f73018b64',protocol=,remote_address_group_id=,remote_group_id=5ca2704a-36a6-44be-843b-b3c729b1a9d0,remote_ip_prefix=,revision_number=0,security_group_id=5ca2704a-36a6-44be-843b-b3c729b1a9d0,updated_at=2022-10-09T00:55:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:46.540024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (73d76d4a-d37c-4021-b136-5edabdbf9c6e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.541523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Security group rule updated ['5ca2704a-36a6-44be-843b-b3c729b1a9d0'] Oct 09 00:55:46.541523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:46Z,description=,direction='ingress',ethertype='IPv6',id=7a6822e1-1f88-4c55-bfde-bcb9cab0674f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88e7a07d04d74e739b7fa17f73018b64',protocol=,remote_address_group_id=,remote_group_id=5ca2704a-36a6-44be-843b-b3c729b1a9d0,remote_ip_prefix=,revision_number=0,security_group_id=5ca2704a-36a6-44be-843b-b3c729b1a9d0,updated_at=2022-10-09T00:55:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:46.543133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7a6822e1-1f88-4c55-bfde-bcb9cab0674f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.543697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Security group rule updated ['5ca2704a-36a6-44be-843b-b3c729b1a9d0'] Oct 09 00:55:46.555694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:46Z,description=,direction='egress',ethertype='IPv4',id=f186b8dd-6211-4f3f-8e1c-cb8a49bb29fd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88e7a07d04d74e739b7fa17f73018b64',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5ca2704a-36a6-44be-843b-b3c729b1a9d0,updated_at=2022-10-09T00:55:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:46.556071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f186b8dd-6211-4f3f-8e1c-cb8a49bb29fd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.557258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Security group rule updated ['5ca2704a-36a6-44be-843b-b3c729b1a9d0'] Oct 09 00:55:46.642321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ebf87ac0-9757-49e8-8660-e39cb972267b None None] Resource Port a12e3d11-0a2d-4089-8565-84afac1050b3 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a12e3d11-0a2d-4089-8565-84afac1050b3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a12e3d11-0a2d-4089-8565-84afac1050b3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a12e3d11-0a2d-4089-8565-84afac1050b3,segment=NetworkSegment(47eb43ca-62f0-426c-bb7d-8fbf6653ed4a),segment_id=47eb43ca-62f0-426c-bb7d-8fbf6653ed4a)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:46.642321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ebf87ac0-9757-49e8-8660-e39cb972267b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a12e3d11-0a2d-4089-8565-84afac1050b3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.692585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:55:46Z,description='',dns_domain=None,id=bd0c3622-3100-4974-8f51-c7c8194d1e19,mtu=1500,name='tempest-DeleteServersTestJSON-1325747164-network',project_id='88e7a07d04d74e739b7fa17f73018b64',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(bd0c3622-3100-4974-8f51-c7c8194d1e19),segments=[NetworkSegment(21f1d887-4a9b-4110-9ac3-3d69ca77915d)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:55:46Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:46.693374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (bd0c3622-3100-4974-8f51-c7c8194d1e19), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.713348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:241 started Oct 09 00:55:46.718068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=38000000,duration_sec=489,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:46.718867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:46.721465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:241 - starting polling. Elapsed:0.006 Oct 09 00:55:46.723811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.725944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:241 - port information retrieved. Elapsed:0.013 Oct 09 00:55:46.726552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:241 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 00:55:46.775837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2452e6b9-8440-48cf-b16f-ba10d531cd71 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:46Z,data_plane_status=None,description='',device_id='fc189697-06c8-4c2b-8790-d39ee18cd896',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=52c9f24a-41b9-4582-897b-a9388e078cc4,mac_address=fa:16:3e:db:b9:7d,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(52c9f24a-41b9-4582-897b-a9388e078cc4),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:46.776226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2452e6b9-8440-48cf-b16f-ba10d531cd71 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (52c9f24a-41b9-4582-897b-a9388e078cc4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:46.821086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ad0b9338-a894-4a83-9455-1a47e72377a2","insert","tapa12e3d11-0a",["set",[]],["map",[["attached-mac","fa:16:3e:2f:ce:5b"],["iface-id","a12e3d11-0a2d-4089-8565-84afac1050b3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ad0b9338-a894-4a83-9455-1a47e72377a2","old",null,["set",[]],null],["","new","tapa12e3d11-0a",6,["map",[["attached-mac","fa:16:3e:2f:ce:5b"],["iface-id","a12e3d11-0a2d-4089-8565-84afac1050b3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-3bcd8dea-3060-4091-8039-80b0fefb9b74 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bd0c3622-3100-4974-8f51-c7c8194d1e19 with segmentation id not found. Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:55:46.918314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bd0c3622-3100-4974-8f51-c7c8194d1e19 with segmentation id not found. Oct 09 00:55:46.919095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:55:47.181417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8ce281c2-3cdd-4378-9041-981f51ee9332 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(0d288587-7215-4b95-8896-5d25d67284b0)],cidr=172.20.0.0/28,created_at=2022-10-09T00:55:46Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=a548fa97-cb20-45d6-8da8-0556662605e1,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-DeleteServersTestJSON-1325747164-subnet',network_id=bd0c3622-3100-4974-8f51-c7c8194d1e19,project_id='88e7a07d04d74e739b7fa17f73018b64',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:55:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:47.182255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8ce281c2-3cdd-4378-9041-981f51ee9332 admin admin] Publish callbacks [] for Subnet (a548fa97-cb20-45d6-8da8-0556662605e1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:48.044229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a00e38b0-736e-4ca2-b5b6-cfdec627fa05 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:47Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-bd0c3622-3100-4974-8f51-c7c8194d1e19',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4c7027d2-8e83-425b-bce4-3a2c26d6231c,mac_address=fa:16:3e:7d:32:64,name='',network_id=bd0c3622-3100-4974-8f51-c7c8194d1e19,numa_affinity_policy=,project_id='88e7a07d04d74e739b7fa17f73018b64',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4c7027d2-8e83-425b-bce4-3a2c26d6231c),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:47Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:48.044983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a00e38b0-736e-4ca2-b5b6-cfdec627fa05 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4c7027d2-8e83-425b-bce4-3a2c26d6231c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:48.714769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:242 started Oct 09 00:55:48.720982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=38000000,duration_sec=491,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:48.720982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:48.720982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:242 - starting polling. Elapsed:0.005 Oct 09 00:55:48.722317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:48.726345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:242 - port information retrieved. Elapsed:0.012 Oct 09 00:55:48.726887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '8909d97f-c5e3-462a-9bad-225ac2909771', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'a12e3d11-0a2d-4089-8565-84afac1050b3'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:55:48.728437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93a9ba3d-37f0-48ce-9786-b421e5404102', 'network_id': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'port_id': 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'mac_address': 'fa:16:3e:2f:ce:5b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 691, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9ba14a53-0198-4c1f-9001-da2b49d70087', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:55:48.734791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: a12e3d11-0a2d-4089-8565-84afac1050b3 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:48.738245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port a12e3d11-0a2d-4089-8565-84afac1050b3 updated. Details: {'device': 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93a9ba3d-37f0-48ce-9786-b421e5404102', 'network_id': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'port_id': 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'mac_address': 'fa:16:3e:2f:ce:5b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 691, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9ba14a53-0198-4c1f-9001-da2b49d70087', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:55:48.738893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 4 as local vlan for net-id=93a9ba3d-37f0-48ce-9786-b421e5404102, seg-id=691 Oct 09 00:55:48.748543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da1827,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4787), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:48.756687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363edc2,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4100)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4787}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:48.758675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapa12e3d11-0a, col_values=(('tag', 4),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:48.764868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapa12e3d11-0a, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:48.765323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapa12e3d11-0a, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:48.788393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapa12e3d11-0a, col_values=(('other_config', {'net_uuid': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '691'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:48.811062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edc4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:48.815268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:242 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.088 Oct 09 00:55:48.816714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:55:48.817192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'a12e3d11-0a2d-4089-8565-84afac1050b3'} Oct 09 00:55:48.819788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:55:48.824021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:55:48.831930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:55:48.975624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ae7740-1596-48aa-8143-985b98452c1d]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:55:48.977283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:242 - agent port security group processed in 0.250 Oct 09 00:55:48.978242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for a12e3d11-0a2d-4089-8565-84afac1050b3 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:55:49.159187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:55:48Z,description='Default security group',id=d1f916c0-5e4a-464a-a471-e22192e192fb,is_default=True,name='default',project_id='a7d8e82f58814da6b8c08bfa04955d4c',revision_number=1,rules=[SecurityGroupRule(15378fd2-c89f-4a7a-9b4d-6a898fe0337e),SecurityGroupRule(862c7403-06b4-4f32-8b59-b836d3ace96e),SecurityGroupRule(b0e94df0-4fa2-4bfc-9ce8-e93313a7c738),SecurityGroupRule(b405d028-6736-45c6-af64-55973cd5942e)],shared=False,stateful=True,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.161307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (d1f916c0-5e4a-464a-a471-e22192e192fb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.163511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:48Z,description=,direction='egress',ethertype='IPv6',id=15378fd2-c89f-4a7a-9b4d-6a898fe0337e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d1f916c0-5e4a-464a-a471-e22192e192fb,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.164649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (15378fd2-c89f-4a7a-9b4d-6a898fe0337e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.165178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Security group rule updated ['d1f916c0-5e4a-464a-a471-e22192e192fb'] Oct 09 00:55:49.166060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:48Z,description=,direction='egress',ethertype='IPv4',id=862c7403-06b4-4f32-8b59-b836d3ace96e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d1f916c0-5e4a-464a-a471-e22192e192fb,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.166617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (862c7403-06b4-4f32-8b59-b836d3ace96e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.167105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Security group rule updated ['d1f916c0-5e4a-464a-a471-e22192e192fb'] Oct 09 00:55:49.168071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:48Z,description=,direction='ingress',ethertype='IPv6',id=b0e94df0-4fa2-4bfc-9ce8-e93313a7c738,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=d1f916c0-5e4a-464a-a471-e22192e192fb,remote_ip_prefix=,revision_number=0,security_group_id=d1f916c0-5e4a-464a-a471-e22192e192fb,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.169331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b0e94df0-4fa2-4bfc-9ce8-e93313a7c738), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.171141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Security group rule updated ['d1f916c0-5e4a-464a-a471-e22192e192fb'] Oct 09 00:55:49.172039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:48Z,description=,direction='ingress',ethertype='IPv4',id=b405d028-6736-45c6-af64-55973cd5942e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=d1f916c0-5e4a-464a-a471-e22192e192fb,remote_ip_prefix=,revision_number=0,security_group_id=d1f916c0-5e4a-464a-a471-e22192e192fb,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.173999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b405d028-6736-45c6-af64-55973cd5942e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.174527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Security group rule updated ['d1f916c0-5e4a-464a-a471-e22192e192fb'] Oct 09 00:55:49.220607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:55:48Z,description='Default security group',id=85d9ef2f-837e-44e1-bda5-e50dc5085b24,is_default=True,name='default',project_id='f68941040b3049bd9c62e2fc061d94c1',revision_number=1,rules=[SecurityGroupRule(20570055-b831-4146-a073-046965a52d79),SecurityGroupRule(6f762666-8204-414b-b7f4-de4831c2dcd9),SecurityGroupRule(8ea821b0-231f-4ceb-b062-ec955027e683),SecurityGroupRule(e999488c-ebb2-4acd-ad08-89025642e509)],shared=False,stateful=True,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.221393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (85d9ef2f-837e-44e1-bda5-e50dc5085b24), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.222870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:48Z,description=,direction='ingress',ethertype='IPv4',id=20570055-b831-4146-a073-046965a52d79,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68941040b3049bd9c62e2fc061d94c1',protocol=,remote_address_group_id=,remote_group_id=85d9ef2f-837e-44e1-bda5-e50dc5085b24,remote_ip_prefix=,revision_number=0,security_group_id=85d9ef2f-837e-44e1-bda5-e50dc5085b24,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.223421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (20570055-b831-4146-a073-046965a52d79), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.224459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Security group rule updated ['85d9ef2f-837e-44e1-bda5-e50dc5085b24'] Oct 09 00:55:49.225344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:48Z,description=,direction='egress',ethertype='IPv6',id=6f762666-8204-414b-b7f4-de4831c2dcd9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68941040b3049bd9c62e2fc061d94c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=85d9ef2f-837e-44e1-bda5-e50dc5085b24,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.226049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6f762666-8204-414b-b7f4-de4831c2dcd9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.226564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Security group rule updated ['85d9ef2f-837e-44e1-bda5-e50dc5085b24'] Oct 09 00:55:49.228377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:48Z,description=,direction='ingress',ethertype='IPv6',id=8ea821b0-231f-4ceb-b062-ec955027e683,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68941040b3049bd9c62e2fc061d94c1',protocol=,remote_address_group_id=,remote_group_id=85d9ef2f-837e-44e1-bda5-e50dc5085b24,remote_ip_prefix=,revision_number=0,security_group_id=85d9ef2f-837e-44e1-bda5-e50dc5085b24,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.232100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8ea821b0-231f-4ceb-b062-ec955027e683), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.233200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Security group rule updated ['85d9ef2f-837e-44e1-bda5-e50dc5085b24'] Oct 09 00:55:49.236918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:48Z,description=,direction='egress',ethertype='IPv4',id=e999488c-ebb2-4acd-ad08-89025642e509,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68941040b3049bd9c62e2fc061d94c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=85d9ef2f-837e-44e1-bda5-e50dc5085b24,updated_at=2022-10-09T00:55:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.237515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e999488c-ebb2-4acd-ad08-89025642e509), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.238044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Security group rule updated ['85d9ef2f-837e-44e1-bda5-e50dc5085b24'] Oct 09 00:55:49.585068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a00e38b0-736e-4ca2-b5b6-cfdec627fa05 None None] Resource Port 4c7027d2-8e83-425b-bce4-3a2c26d6231c updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4c7027d2-8e83-425b-bce4-3a2c26d6231c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4c7027d2-8e83-425b-bce4-3a2c26d6231c,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4c7027d2-8e83-425b-bce4-3a2c26d6231c,segment=NetworkSegment(21f1d887-4a9b-4110-9ac3-3d69ca77915d),segment_id=21f1d887-4a9b-4110-9ac3-3d69ca77915d)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:49.586094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a00e38b0-736e-4ca2-b5b6-cfdec627fa05 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4c7027d2-8e83-425b-bce4-3a2c26d6231c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.769853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0fb4e4ff-13ec-41fc-946a-a45c7a782db2","insert","tap4c7027d2-8e",["set",[]],["map",[["attached-mac","fa:16:3e:7d:32:64"],["iface-id","4c7027d2-8e83-425b-bce4-3a2c26d6231c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:49.797860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0fb4e4ff-13ec-41fc-946a-a45c7a782db2","old",null,["set",[]],null],["","new","tap4c7027d2-8e",7,["map",[["attached-mac","fa:16:3e:7d:32:64"],["iface-id","4c7027d2-8e83-425b-bce4-3a2c26d6231c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:49.942566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c0011432-daaa-4f73-9ea6-5358234dea23 None None] Resource Port a12e3d11-0a2d-4089-8565-84afac1050b3 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:49.943181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c0011432-daaa-4f73-9ea6-5358234dea23 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a12e3d11-0a2d-4089-8565-84afac1050b3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:49.964502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5b89b046-4280-49da-92f0-67cafc3d6423 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:49Z,data_plane_status=None,description='',device_id='fc189697-06c8-4c2b-8790-d39ee18cd896',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fad9b6dc-752f-4312-9fb4-3e5be2dec7ea,mac_address=fa:16:3e:7e:9e:05,name='',network_id=93a9ba3d-37f0-48ce-9786-b421e5404102,numa_affinity_policy=,project_id='40e631c5e320489cac9cea85118c6263',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fad9b6dc-752f-4312-9fb4-3e5be2dec7ea),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:49Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:49.968337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5b89b046-4280-49da-92f0-67cafc3d6423 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (fad9b6dc-752f-4312-9fb4-3e5be2dec7ea), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:50.241565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:55:49Z,description='',dns_domain=None,id=dd937102-41e7-4629-a161-cb0fb39a0995,mtu=1500,name='tempest-ServerRescueNegativeTestJSON-856707565-network',project_id='f68941040b3049bd9c62e2fc061d94c1',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(dd937102-41e7-4629-a161-cb0fb39a0995),segments=[NetworkSegment(8baf8725-752c-48bf-80b5-a9b2d3636b8e)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:55:49Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:50.244695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (dd937102-41e7-4629-a161-cb0fb39a0995), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:50.350429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:55:49Z,description='',dns_domain=None,id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,mtu=1500,name='tempest-AttachVolumeNegativeTest-2082410444-network',project_id='a7d8e82f58814da6b8c08bfa04955d4c',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(ef6b019b-3ff0-42c3-b2bd-354f2c856ccc),segments=[NetworkSegment(e02957c6-4ac3-44cc-ac85-3fb22cee1088)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:55:49Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:50.350811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (ef6b019b-3ff0-42c3-b2bd-354f2c856ccc), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-60d4e41e-7693-4cb1-906c-5ea265092a5e admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network dd937102-41e7-4629-a161-cb0fb39a0995 with segmentation id not found. Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:55:50.433979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:55:50.434966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:55:50.434966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:55:50.434966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:55:50.434966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network dd937102-41e7-4629-a161-cb0fb39a0995 with segmentation id not found. Oct 09 00:55:50.434966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-2bae30ae-b907-4ca5-a0c1-f684a2b14c8d admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ef6b019b-3ff0-42c3-b2bd-354f2c856ccc with segmentation id not found. Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:55:50.631380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:55:50.632175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:55:50.632175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:55:50.632175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:55:50.632175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ef6b019b-3ff0-42c3-b2bd-354f2c856ccc with segmentation id not found. Oct 09 00:55:50.632175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:55:50.635626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['a12e3d11-0a2d-4089-8565-84afac1050b3'] and devices down [] completed. Oct 09 00:55:50.635940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:242 - ports processed. Elapsed:1.921 Oct 09 00:55:50.636380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:242 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:1.922 Oct 09 00:55:50.716755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:243 started Oct 09 00:55:50.719505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=40000000,duration_sec=493,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:50.720465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:50.720942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:243 - starting polling. Elapsed:0.004 Oct 09 00:55:50.722401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:50.724035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:243 - port information retrieved. Elapsed:0.008 Oct 09 00:55:50.724353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c'}, 'removed': set(), 'updated': {'a12e3d11-0a2d-4089-8565-84afac1050b3', '4c7027d2-8e83-425b-bce4-3a2c26d6231c'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:55:50.724911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93a9ba3d-37f0-48ce-9786-b421e5404102', 'network_id': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'port_id': 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'mac_address': 'fa:16:3e:2f:ce:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 691, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9ba14a53-0198-4c1f-9001-da2b49d70087', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:55:50.725369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '4c7027d2-8e83-425b-bce4-3a2c26d6231c', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-bd0c3622-3100-4974-8f51-c7c8194d1e19', 'network_id': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'port_id': '4c7027d2-8e83-425b-bce4-3a2c26d6231c', 'mac_address': 'fa:16:3e:7d:32:64', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a548fa97-cb20-45d6-8da8-0556662605e1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:55:50.727039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: a12e3d11-0a2d-4089-8565-84afac1050b3 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:50.743785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port a12e3d11-0a2d-4089-8565-84afac1050b3 updated. Details: {'device': 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93a9ba3d-37f0-48ce-9786-b421e5404102', 'network_id': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'port_id': 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'mac_address': 'fa:16:3e:2f:ce:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 691, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9ba14a53-0198-4c1f-9001-da2b49d70087', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 09 00:55:50.751081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapa12e3d11-0a, col_values=(('tag', 4),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:50.752369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapa12e3d11-0a, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:50.752916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapa12e3d11-0a, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:50.753504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:55:50.754458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapa12e3d11-0a, col_values=(('other_config', {'net_uuid': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '691', 'tag': '4'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:50.755913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:55:50.771998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edc8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:50.776530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 4c7027d2-8e83-425b-bce4-3a2c26d6231c {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:50.777126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 4c7027d2-8e83-425b-bce4-3a2c26d6231c updated. Details: {'device': '4c7027d2-8e83-425b-bce4-3a2c26d6231c', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-bd0c3622-3100-4974-8f51-c7c8194d1e19', 'network_id': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'port_id': '4c7027d2-8e83-425b-bce4-3a2c26d6231c', 'mac_address': 'fa:16:3e:7d:32:64', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a548fa97-cb20-45d6-8da8-0556662605e1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:55:50.777634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 5 as local vlan for net-id=bd0c3622-3100-4974-8f51-c7c8194d1e19, seg-id=657 Oct 09 00:55:50.790485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da1829,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4753), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:50.793820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363edca,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4101)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4753}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:50.794819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4c7027d2-8e, col_values=(('tag', 5),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:50.795249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap4c7027d2-8e, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:50.795729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap4c7027d2-8e, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:50.807350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4c7027d2-8e, col_values=(('other_config', {'net_uuid': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '657'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:50.819706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edcc,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:50.820263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:243 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 6 devices currently available. Time elapsed: 0.095 Oct 09 00:55:50.820832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:55:50.821563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'4c7027d2-8e83-425b-bce4-3a2c26d6231c'} Oct 09 00:55:50.823706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:55:50.824334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:55:50.828372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:55:50.957700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cda7c846-8029-4915-9391-83c9bb11673a admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:49Z,data_plane_status=None,description='',device_id='2f12aa77-8149-4cd7-8101-44788eeaa82b',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5,mac_address=fa:16:3e:92:0a:b8,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:49Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:50.958197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cda7c846-8029-4915-9391-83c9bb11673a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:50.982376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6632f-8021-47e3-a530-f12588a747a9]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:55:50.983337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:55:50.983878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:55:50.985218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:55:50.985695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:55:50.988661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:55:51.069335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5eec44-4696-4ab9-8f46-00bf4d209558]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:55:51.070371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:243 - agent port security group processed in 0.346 Oct 09 00:55:51.071327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for a12e3d11-0a2d-4089-8565-84afac1050b3 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:55:51.075169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 4c7027d2-8e83-425b-bce4-3a2c26d6231c to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:55:51.159145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-71834b56-804c-4883-b5fe-28c50a8b1356 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(588902c0-26c3-440e-b9eb-3b6fe61fa25d)],cidr=172.20.0.0/28,created_at=2022-10-09T00:55:50Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=ff98a4f2-ed81-452c-99a3-cf1c43a2d01b,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeNegativeTest-2082410444-subnet',network_id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,project_id='a7d8e82f58814da6b8c08bfa04955d4c',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:55:50Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:51.160340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-71834b56-804c-4883-b5fe-28c50a8b1356 admin admin] Publish callbacks [] for Subnet (ff98a4f2-ed81-452c-99a3-cf1c43a2d01b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:51.277273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52b8fe0c-415b-49f3-a892-327331893eca None None] Resource Port 52c9f24a-41b9-4582-897b-a9388e078cc4 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=52c9f24a-41b9-4582-897b-a9388e078cc4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52c9f24a-41b9-4582-897b-a9388e078cc4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:51.278027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52b8fe0c-415b-49f3-a892-327331893eca None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (52c9f24a-41b9-4582-897b-a9388e078cc4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:51.618727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52b8fe0c-415b-49f3-a892-327331893eca None None] Resource Port 52c9f24a-41b9-4582-897b-a9388e078cc4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52c9f24a-41b9-4582-897b-a9388e078cc4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52c9f24a-41b9-4582-897b-a9388e078cc4,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=52c9f24a-41b9-4582-897b-a9388e078cc4,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:51.618998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52b8fe0c-415b-49f3-a892-327331893eca None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (52c9f24a-41b9-4582-897b-a9388e078cc4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:52.170491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52477532-5a94-47d0-ad89-7e4a1350b141 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(18169a2a-1e0e-4608-b426-ee939cfd26bd)],cidr=172.20.0.0/28,created_at=2022-10-09T00:55:50Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=e75c4721-9fa7-417f-9e12-2a9e53f66ae7,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-ServerRescueNegativeTestJSON-856707565-subnet',network_id=dd937102-41e7-4629-a161-cb0fb39a0995,project_id='f68941040b3049bd9c62e2fc061d94c1',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:55:50Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:52.171251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52477532-5a94-47d0-ad89-7e4a1350b141 admin admin] Publish callbacks [] for Subnet (e75c4721-9fa7-417f-9e12-2a9e53f66ae7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:52.772612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c47ab95c-3839-4f6f-b674-c16f6f84cb25","insert","qr-fad9b6dc-75",["set",[]],["map",[["attached-mac","fa:16:3e:7e:9e:05"],["iface-id","fad9b6dc-752f-4312-9fb4-3e5be2dec7ea"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:52.797613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c47ab95c-3839-4f6f-b674-c16f6f84cb25","old",null,["set",[]],null],["","new","qr-fad9b6dc-75",8,["map",[["attached-mac","fa:16:3e:7e:9e:05"],["iface-id","fad9b6dc-752f-4312-9fb4-3e5be2dec7ea"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:52.963105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-70171a6b-aa82-447e-baf8-ef49cdbd94e8 None None] Resource Port 4c7027d2-8e83-425b-bce4-3a2c26d6231c updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:52.963945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-70171a6b-aa82-447e-baf8-ef49cdbd94e8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4c7027d2-8e83-425b-bce4-3a2c26d6231c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:53.007549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5b89b046-4280-49da-92f0-67cafc3d6423 admin admin] Received resource Port update without any changes: fad9b6dc-752f-4312-9fb4-3e5be2dec7ea {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 00:55:53.441250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9b3d3b1f-6d47-477a-b6fd-5d9b854a3ae0","insert","qg-52c9f24a-41",["set",[]],["map",[["attached-mac","fa:16:3e:db:b9:7d"],["iface-id","52c9f24a-41b9-4582-897b-a9388e078cc4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:53.469509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9b3d3b1f-6d47-477a-b6fd-5d9b854a3ae0","old",null,["set",[]],null],["","new","qg-52c9f24a-41",9,["map",[["attached-mac","fa:16:3e:db:b9:7d"],["iface-id","52c9f24a-41b9-4582-897b-a9388e078cc4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:53.720046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['a12e3d11-0a2d-4089-8565-84afac1050b3', '4c7027d2-8e83-425b-bce4-3a2c26d6231c'] and devices down [] completed. Oct 09 00:55:53.721082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:243 - ports processed. Elapsed:3.005 Oct 09 00:55:53.721559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:243 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:3.005 Oct 09 00:55:53.722506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Loop iteration exceeded interval (2 vs. 3.005054235458374)! {{(pid=107274) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 09 00:55:53.722979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:244 started Oct 09 00:55:53.726820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=46000000,duration_sec=496,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:53.727608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:53.728279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:244 - starting polling. Elapsed:0.005 Oct 09 00:55:53.730036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:53.732333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:244 - port information retrieved. Elapsed:0.009 Oct 09 00:55:53.732850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '52c9f24a-41b9-4582-897b-a9388e078cc4', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '52c9f24a-41b9-4582-897b-a9388e078cc4'}, 'removed': set(), 'updated': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c', '52c9f24a-41b9-4582-897b-a9388e078cc4'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:55:53.733775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '4c7027d2-8e83-425b-bce4-3a2c26d6231c', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-bd0c3622-3100-4974-8f51-c7c8194d1e19', 'network_id': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'port_id': '4c7027d2-8e83-425b-bce4-3a2c26d6231c', 'mac_address': 'fa:16:3e:7d:32:64', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a548fa97-cb20-45d6-8da8-0556662605e1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:55:53.734792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:49Z,data_plane_status=None,description='',device_id='fc189697-06c8-4c2b-8790-d39ee18cd896',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fad9b6dc-752f-4312-9fb4-3e5be2dec7ea,mac_address=fa:16:3e:7e:9e:05,name='',network_id=93a9ba3d-37f0-48ce-9786-b421e5404102,numa_affinity_policy=,project_id='40e631c5e320489cac9cea85118c6263',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(fad9b6dc-752f-4312-9fb4-3e5be2dec7ea),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:51Z) is not bound. Oct 09 00:55:53.735877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '52c9f24a-41b9-4582-897b-a9388e078cc4', 'device_id': 'fc189697-06c8-4c2b-8790-d39ee18cd896', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '52c9f24a-41b9-4582-897b-a9388e078cc4', 'mac_address': 'fa:16:3e:db:b9:7d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.235'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:55:53.747439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 4c7027d2-8e83-425b-bce4-3a2c26d6231c {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:53.749204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 4c7027d2-8e83-425b-bce4-3a2c26d6231c updated. Details: {'device': '4c7027d2-8e83-425b-bce4-3a2c26d6231c', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-bd0c3622-3100-4974-8f51-c7c8194d1e19', 'network_id': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'port_id': '4c7027d2-8e83-425b-bce4-3a2c26d6231c', 'mac_address': 'fa:16:3e:7d:32:64', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a548fa97-cb20-45d6-8da8-0556662605e1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 09 00:55:53.750447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4c7027d2-8e, col_values=(('tag', 5),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:53.751038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap4c7027d2-8e, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:53.751631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap4c7027d2-8e, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:53.752203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:55:53.753486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4c7027d2-8e, col_values=(('other_config', {'net_uuid': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '657', 'tag': '5'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:53.754590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:55:53.757786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edd0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:53.758352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: fad9b6dc-752f-4312-9fb4-3e5be2dec7ea {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:53.758795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device fad9b6dc-752f-4312-9fb4-3e5be2dec7ea not defined on plugin or binding failed Oct 09 00:55:53.759467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 52c9f24a-41b9-4582-897b-a9388e078cc4 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:53.759947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 52c9f24a-41b9-4582-897b-a9388e078cc4 updated. Details: {'device': '52c9f24a-41b9-4582-897b-a9388e078cc4', 'device_id': 'fc189697-06c8-4c2b-8790-d39ee18cd896', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '52c9f24a-41b9-4582-897b-a9388e078cc4', 'mac_address': 'fa:16:3e:db:b9:7d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.235'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:55:53.761326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52c9f24a-41, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:53.761868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-52c9f24a-41, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:53.762433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-52c9f24a-41, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:53.777180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52c9f24a-41, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:53.790276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edd2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:53.790859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:244 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.058 Oct 09 00:55:53.791372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 2 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:55:53.791835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '52c9f24a-41b9-4582-897b-a9388e078cc4'} Oct 09 00:55:53.793632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:55:53.794104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:55:53.797925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:55:53.844115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[368422a6-c90f-4be8-bd28-033dcfd658eb]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:55:53.844645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:55:53.844948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:55:53.846690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:55:53.846984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:55:53.849816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:55:53.914307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4299a5-30d3-4d0c-9fe9-1c14f5895627]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:55:53.914935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:244 - agent port security group processed in 0.182 Oct 09 00:55:53.916064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 4c7027d2-8e83-425b-bce4-3a2c26d6231c to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:55:53.916498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 52c9f24a-41b9-4582-897b-a9388e078cc4 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:55:53.935099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3b9460fd-1361-4106-a2d5-feec3f97c166 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:52Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ef6b019b-3ff0-42c3-b2bd-354f2c856ccc',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1,mac_address=fa:16:3e:ea:52:b9,name='',network_id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,numa_affinity_policy=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:53.936077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3b9460fd-1361-4106-a2d5-feec3f97c166 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.368635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:55:53Z,description='Default security group',id=9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e,is_default=True,name='default',project_id='0ef954aff8eb4042b4fedfc47c6d073e',revision_number=1,rules=[SecurityGroupRule(02cfec84-547a-4291-98c8-a700a8a57898),SecurityGroupRule(59077b57-3aab-4b36-878c-6167257baddd),SecurityGroupRule(9ae2df36-13e8-48bd-ab66-75e5bf634b4e),SecurityGroupRule(b08348d4-2ff7-42ad-99fd-2693af089e5b)],shared=False,stateful=True,updated_at=2022-10-09T00:55:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:54.369270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.370093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:53Z,description=,direction='egress',ethertype='IPv4',id=02cfec84-547a-4291-98c8-a700a8a57898,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ef954aff8eb4042b4fedfc47c6d073e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e,updated_at=2022-10-09T00:55:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:54.370601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (02cfec84-547a-4291-98c8-a700a8a57898), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.371077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Security group rule updated ['9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e'] Oct 09 00:55:54.372178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:53Z,description=,direction='egress',ethertype='IPv6',id=59077b57-3aab-4b36-878c-6167257baddd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ef954aff8eb4042b4fedfc47c6d073e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e,updated_at=2022-10-09T00:55:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:54.372577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (59077b57-3aab-4b36-878c-6167257baddd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.372909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Security group rule updated ['9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e'] Oct 09 00:55:54.373581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:53Z,description=,direction='ingress',ethertype='IPv4',id=9ae2df36-13e8-48bd-ab66-75e5bf634b4e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ef954aff8eb4042b4fedfc47c6d073e',protocol=,remote_address_group_id=,remote_group_id=9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e,remote_ip_prefix=,revision_number=0,security_group_id=9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e,updated_at=2022-10-09T00:55:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:54.375621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9ae2df36-13e8-48bd-ab66-75e5bf634b4e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.376013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Security group rule updated ['9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e'] Oct 09 00:55:54.384062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:53Z,description=,direction='ingress',ethertype='IPv6',id=b08348d4-2ff7-42ad-99fd-2693af089e5b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ef954aff8eb4042b4fedfc47c6d073e',protocol=,remote_address_group_id=,remote_group_id=9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e,remote_ip_prefix=,revision_number=0,security_group_id=9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e,updated_at=2022-10-09T00:55:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:54.384488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b08348d4-2ff7-42ad-99fd-2693af089e5b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.384833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d08043fa-5206-48f4-86f2-e088e8ef2082 admin admin] Security group rule updated ['9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e'] Oct 09 00:55:54.551520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Resource SecurityGroup deleted: 9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:54.551974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.552421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:55:54.659923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:55:54.660868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Resource SecurityGroupRule deleted: 02cfec84-547a-4291-98c8-a700a8a57898 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:54.661568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (02cfec84-547a-4291-98c8-a700a8a57898), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.664227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Security group rule updated ['9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e'] Oct 09 00:55:54.664930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Resource SecurityGroupRule deleted: 59077b57-3aab-4b36-878c-6167257baddd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:54.665552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (59077b57-3aab-4b36-878c-6167257baddd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.666251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Security group rule updated ['9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e'] Oct 09 00:55:54.666766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Resource SecurityGroupRule deleted: 9ae2df36-13e8-48bd-ab66-75e5bf634b4e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:54.667254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9ae2df36-13e8-48bd-ab66-75e5bf634b4e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.667808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Security group rule updated ['9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e'] Oct 09 00:55:54.668355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Resource SecurityGroupRule deleted: b08348d4-2ff7-42ad-99fd-2693af089e5b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:54.669006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b08348d4-2ff7-42ad-99fd-2693af089e5b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:54.670314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce8553b5-2fb0-4b5e-9f6b-d12517e8a8b5 admin admin] Security group rule updated ['9aa8e3b9-078c-4b51-98b9-a94ea3df0b4e'] Oct 09 00:55:54.793490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-05bf1a38-ca8e-43d2-98ab-328f1819e2d5 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:53Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd937102-41e7-4629-a161-cb0fb39a0995',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=95de155f-70c1-4bf8-a59a-656fdfc1f414,mac_address=fa:16:3e:ed:13:1f,name='',network_id=dd937102-41e7-4629-a161-cb0fb39a0995,numa_affinity_policy=,project_id='f68941040b3049bd9c62e2fc061d94c1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(95de155f-70c1-4bf8-a59a-656fdfc1f414),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:54Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:54.803121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-05bf1a38-ca8e-43d2-98ab-328f1819e2d5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (95de155f-70c1-4bf8-a59a-656fdfc1f414), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.088796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5ddea7bd-dac5-47d0-bd9a-2a60e35d9a26","insert","tap8a28fe29-98",["set",[]],["map",[["attached-mac","fa:16:3e:ea:52:b9"],["iface-id","8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:55.108559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5ddea7bd-dac5-47d0-bd9a-2a60e35d9a26","old",null,["set",[]],null],["","new","tap8a28fe29-98",10,["map",[["attached-mac","fa:16:3e:ea:52:b9"],["iface-id","8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:55.412304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3b9460fd-1361-4106-a2d5-feec3f97c166 None None] Resource Port 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1,segment=NetworkSegment(e02957c6-4ac3-44cc-ac85-3fb22cee1088),segment_id=e02957c6-4ac3-44cc-ac85-3fb22cee1088)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:55.412783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3b9460fd-1361-4106-a2d5-feec3f97c166 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.447495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:55:55Z,description='Default security group',id=35f49130-d3db-477a-82a2-c42d6795ccd7,is_default=True,name='default',project_id='f83c1519130d44cc8930a375b6e026e3',revision_number=1,rules=[SecurityGroupRule(13e4e4c2-4d29-47ab-9473-437ad8c30200),SecurityGroupRule(2cfea79d-bcbb-4587-b149-18be532c45f3),SecurityGroupRule(435d0c83-3d5f-4922-8651-e1afbae7f1c6),SecurityGroupRule(9b441c12-ec9f-4f81-8893-36ee43bc3d6f)],shared=False,stateful=True,updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:55.448569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (35f49130-d3db-477a-82a2-c42d6795ccd7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.449216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:55Z,description=,direction='egress',ethertype='IPv4',id=13e4e4c2-4d29-47ab-9473-437ad8c30200,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f83c1519130d44cc8930a375b6e026e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=35f49130-d3db-477a-82a2-c42d6795ccd7,updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:55.449578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (13e4e4c2-4d29-47ab-9473-437ad8c30200), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.449914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Security group rule updated ['35f49130-d3db-477a-82a2-c42d6795ccd7'] Oct 09 00:55:55.450771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:55Z,description=,direction='ingress',ethertype='IPv4',id=2cfea79d-bcbb-4587-b149-18be532c45f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f83c1519130d44cc8930a375b6e026e3',protocol=,remote_address_group_id=,remote_group_id=35f49130-d3db-477a-82a2-c42d6795ccd7,remote_ip_prefix=,revision_number=0,security_group_id=35f49130-d3db-477a-82a2-c42d6795ccd7,updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:55.451281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2cfea79d-bcbb-4587-b149-18be532c45f3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.451793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Security group rule updated ['35f49130-d3db-477a-82a2-c42d6795ccd7'] Oct 09 00:55:55.453226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:55Z,description=,direction='ingress',ethertype='IPv6',id=435d0c83-3d5f-4922-8651-e1afbae7f1c6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f83c1519130d44cc8930a375b6e026e3',protocol=,remote_address_group_id=,remote_group_id=35f49130-d3db-477a-82a2-c42d6795ccd7,remote_ip_prefix=,revision_number=0,security_group_id=35f49130-d3db-477a-82a2-c42d6795ccd7,updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:55.453744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (435d0c83-3d5f-4922-8651-e1afbae7f1c6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.460140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Security group rule updated ['35f49130-d3db-477a-82a2-c42d6795ccd7'] Oct 09 00:55:55.463625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:55Z,description=,direction='egress',ethertype='IPv6',id=9b441c12-ec9f-4f81-8893-36ee43bc3d6f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f83c1519130d44cc8930a375b6e026e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=35f49130-d3db-477a-82a2-c42d6795ccd7,updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:55.464180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9b441c12-ec9f-4f81-8893-36ee43bc3d6f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.464667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cda99b31-0560-453e-b691-e67502cce828 admin admin] Security group rule updated ['35f49130-d3db-477a-82a2-c42d6795ccd7'] Oct 09 00:55:55.677196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ba9f537-bd42-4ec0-bd68-f84175ecdba8 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:54Z,data_plane_status=None,description='',device_id='2f12aa77-8149-4cd7-8101-44788eeaa82b',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e219175f-338c-47ca-ba2c-40a73c82d3b3,mac_address=fa:16:3e:65:4f:bc,name='',network_id=bd0c3622-3100-4974-8f51-c7c8194d1e19,numa_affinity_policy=,project_id='88e7a07d04d74e739b7fa17f73018b64',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e219175f-338c-47ca-ba2c-40a73c82d3b3),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:55.677905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ba9f537-bd42-4ec0-bd68-f84175ecdba8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e219175f-338c-47ca-ba2c-40a73c82d3b3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.700436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8c8224f0-396b-4cc0-9252-0b36ce96ac63 None None] Resource Port 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:55.701272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8c8224f0-396b-4cc0-9252-0b36ce96ac63 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.714427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Resource SecurityGroup deleted: 35f49130-d3db-477a-82a2-c42d6795ccd7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:55.715802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (35f49130-d3db-477a-82a2-c42d6795ccd7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.718108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('35f49130-d3db-477a-82a2-c42d6795ccd7',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:55:55.767392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['4c7027d2-8e83-425b-bce4-3a2c26d6231c', '52c9f24a-41b9-4582-897b-a9388e078cc4'] and devices down [] completed. Oct 09 00:55:55.768242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:244 - ports processed. Elapsed:2.045 Oct 09 00:55:55.769025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:244 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:2.046 Oct 09 00:55:55.770100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Loop iteration exceeded interval (2 vs. 2.045835018157959)! {{(pid=107274) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 09 00:55:55.770563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:245 started Oct 09 00:55:55.775019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=95000000,duration_sec=498,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:55.776124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:55.778536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:245 - starting polling. Elapsed:0.007 Oct 09 00:55:55.785442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.791467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:245 - port information retrieved. Elapsed:0.021 Oct 09 00:55:55.792952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1'}, 'removed': set(), 'updated': {'8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:55:55.794823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'network_id': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'port_id': '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'mac_address': 'fa:16:3e:ea:52:b9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ff98a4f2-ed81-452c-99a3-cf1c43a2d01b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:55:55.803175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:55.804134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 updated. Details: {'device': '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'network_id': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'port_id': '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'mac_address': 'fa:16:3e:ea:52:b9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ff98a4f2-ed81-452c-99a3-cf1c43a2d01b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:55:55.807932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 6 as local vlan for net-id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc, seg-id=689 Oct 09 00:55:55.810940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('35f49130-d3db-477a-82a2-c42d6795ccd7',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:55:55.811664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Resource SecurityGroupRule deleted: 13e4e4c2-4d29-47ab-9473-437ad8c30200 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:55.812319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (13e4e4c2-4d29-47ab-9473-437ad8c30200), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.812912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Security group rule updated ['35f49130-d3db-477a-82a2-c42d6795ccd7'] Oct 09 00:55:55.813478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Resource SecurityGroupRule deleted: 2cfea79d-bcbb-4587-b149-18be532c45f3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:55.814324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2cfea79d-bcbb-4587-b149-18be532c45f3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.814780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Security group rule updated ['35f49130-d3db-477a-82a2-c42d6795ccd7'] Oct 09 00:55:55.815379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Resource SecurityGroupRule deleted: 435d0c83-3d5f-4922-8651-e1afbae7f1c6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:55.815940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (435d0c83-3d5f-4922-8651-e1afbae7f1c6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.816891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Security group rule updated ['35f49130-d3db-477a-82a2-c42d6795ccd7'] Oct 09 00:55:55.817724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Resource SecurityGroupRule deleted: 9b441c12-ec9f-4f81-8893-36ee43bc3d6f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:55:55.818360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9b441c12-ec9f-4f81-8893-36ee43bc3d6f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:55.818830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-00d321c2-cb93-4352-bd42-e304bf3ec8de admin admin] Security group rule updated ['35f49130-d3db-477a-82a2-c42d6795ccd7'] Oct 09 00:55:55.828950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da182b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4785), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:55.838744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363edd6,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4102)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4785}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:55.841443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a28fe29-98, col_values=(('tag', 6),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:55.842160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap8a28fe29-98, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:55.846097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap8a28fe29-98, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:55.859752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a28fe29-98, col_values=(('other_config', {'net_uuid': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '689'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:55.900190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edd8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:55.902381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:245 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.107 Oct 09 00:55:55.902767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:55:55.903069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1'} Oct 09 00:55:55.907141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:55:55.909820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:55:55.920896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:55:56.047551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 52c9f24a-41b9-4582-897b-a9388e078cc4 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=52c9f24a-41b9-4582-897b-a9388e078cc4,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=52c9f24a-41b9-4582-897b-a9388e078cc4,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:56.048527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (52c9f24a-41b9-4582-897b-a9388e078cc4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:56.058186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[185c37c5-4edf-4537-8b62-d1902533f377]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:55:56.059614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:245 - agent port security group processed in 0.266 Oct 09 00:55:56.060442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:55:56.344744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f40a3ff3-80f8-4f00-a7aa-d89e160f48d6","insert","tap95de155f-70",["set",[]],["map",[["attached-mac","fa:16:3e:ed:13:1f"],["iface-id","95de155f-70c1-4bf8-a59a-656fdfc1f414"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:56.399117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f40a3ff3-80f8-4f00-a7aa-d89e160f48d6","old",null,["set",[]],null],["","new","tap95de155f-70",11,["map",[["attached-mac","fa:16:3e:ed:13:1f"],["iface-id","95de155f-70c1-4bf8-a59a-656fdfc1f414"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:56.431535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11163def-0412-4fa0-9aee-de03cd9c2892 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:55:55Z,description='tempest-description--1977943427',id=40866277-1b5e-448e-aa7a-22cc7be390c9,is_default=False,name='tempest-securitygroup--716288298',project_id='40e631c5e320489cac9cea85118c6263',revision_number=1,rules=[SecurityGroupRule(1bbebb52-de77-4783-a1e8-86a6bc6a76be),SecurityGroupRule(2d70d5cf-f1b2-4920-b4e5-26637c56de54)],shared=False,stateful=True,updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:56.436009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11163def-0412-4fa0-9aee-de03cd9c2892 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (40866277-1b5e-448e-aa7a-22cc7be390c9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:56.439624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11163def-0412-4fa0-9aee-de03cd9c2892 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:55Z,description=,direction='egress',ethertype='IPv6',id=1bbebb52-de77-4783-a1e8-86a6bc6a76be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=40866277-1b5e-448e-aa7a-22cc7be390c9,updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:56.444753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11163def-0412-4fa0-9aee-de03cd9c2892 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1bbebb52-de77-4783-a1e8-86a6bc6a76be), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:56.448042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11163def-0412-4fa0-9aee-de03cd9c2892 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['40866277-1b5e-448e-aa7a-22cc7be390c9'] Oct 09 00:55:56.450411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11163def-0412-4fa0-9aee-de03cd9c2892 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:55Z,description=,direction='egress',ethertype='IPv4',id=2d70d5cf-f1b2-4920-b4e5-26637c56de54,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=40866277-1b5e-448e-aa7a-22cc7be390c9,updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:56.451368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11163def-0412-4fa0-9aee-de03cd9c2892 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2d70d5cf-f1b2-4920-b4e5-26637c56de54), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:56.455317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11163def-0412-4fa0-9aee-de03cd9c2892 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['40866277-1b5e-448e-aa7a-22cc7be390c9'] Oct 09 00:55:56.489098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-05bf1a38-ca8e-43d2-98ab-328f1819e2d5 None None] Resource Port 95de155f-70c1-4bf8-a59a-656fdfc1f414 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=95de155f-70c1-4bf8-a59a-656fdfc1f414,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=95de155f-70c1-4bf8-a59a-656fdfc1f414,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=95de155f-70c1-4bf8-a59a-656fdfc1f414,segment=NetworkSegment(8baf8725-752c-48bf-80b5-a9b2d3636b8e),segment_id=8baf8725-752c-48bf-80b5-a9b2d3636b8e)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:56.489489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-05bf1a38-ca8e-43d2-98ab-328f1819e2d5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (95de155f-70c1-4bf8-a59a-656fdfc1f414), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:56.898273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b9a2cdd1-8284-4344-ab5c-a23a4d2602b2 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:56Z,description='',direction='ingress',ethertype='IPv4',id=a3c8b13e-6dcb-464d-868b-50ddba5e3219,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='40e631c5e320489cac9cea85118c6263',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=40866277-1b5e-448e-aa7a-22cc7be390c9,updated_at=2022-10-09T00:55:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:56.898963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b9a2cdd1-8284-4344-ab5c-a23a4d2602b2 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a3c8b13e-6dcb-464d-868b-50ddba5e3219), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:56.899516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b9a2cdd1-8284-4344-ab5c-a23a4d2602b2 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['40866277-1b5e-448e-aa7a-22cc7be390c9'] Oct 09 00:55:57.167743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8c8224f0-396b-4cc0-9252-0b36ce96ac63 None None] Resource Port 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:57.168496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8c8224f0-396b-4cc0-9252-0b36ce96ac63 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:57.235373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9747f8cd-a17b-4f0e-8fc1-cb192016c1b1 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:55:57Z,description='',direction='ingress',ethertype='IPv4',id=dfa4f977-10b3-454c-bea6-78915956a806,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=40866277-1b5e-448e-aa7a-22cc7be390c9,updated_at=2022-10-09T00:55:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:57.235980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9747f8cd-a17b-4f0e-8fc1-cb192016c1b1 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (dfa4f977-10b3-454c-bea6-78915956a806), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:57.236488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9747f8cd-a17b-4f0e-8fc1-cb192016c1b1 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['40866277-1b5e-448e-aa7a-22cc7be390c9'] Oct 09 00:55:57.429780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6b8a1086-bd23-45c0-9ce2-186f7c496b0b admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:54Z,data_plane_status=None,description='',device_id='c529cd40-e1fc-484f-b522-0bebbee463a2',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2,mac_address=fa:16:3e:fd:41:e9,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:57.430176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6b8a1086-bd23-45c0-9ce2-186f7c496b0b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:57.433410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1'] and devices down [] completed. Oct 09 00:55:57.434157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:245 - ports processed. Elapsed:1.664 Oct 09 00:55:57.434599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:245 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.664 Oct 09 00:55:57.574229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc7c1ee-df35-4a32-a7dc-d1d4dbea6c27 None None] Resource Port fad9b6dc-752f-4312-9fb4-3e5be2dec7ea updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=fad9b6dc-752f-4312-9fb4-3e5be2dec7ea,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fad9b6dc-752f-4312-9fb4-3e5be2dec7ea,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:57.574687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc7c1ee-df35-4a32-a7dc-d1d4dbea6c27 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (fad9b6dc-752f-4312-9fb4-3e5be2dec7ea), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:57.772080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:246 started Oct 09 00:55:57.775912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=96000000,duration_sec=500,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:57.776633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:55:57.777779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:246 - starting polling. Elapsed:0.006 Oct 09 00:55:57.782005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:57.800743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:246 - port information retrieved. Elapsed:0.029 Oct 09 00:55:57.802312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '95de155f-70c1-4bf8-a59a-656fdfc1f414', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'95de155f-70c1-4bf8-a59a-656fdfc1f414'}, 'removed': set(), 'updated': {'95de155f-70c1-4bf8-a59a-656fdfc1f414', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '52c9f24a-41b9-4582-897b-a9388e078cc4'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:55:57.803736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd937102-41e7-4629-a161-cb0fb39a0995', 'network_id': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'port_id': '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'mac_address': 'fa:16:3e:ed:13:1f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'e75c4721-9fa7-417f-9e12-2a9e53f66ae7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:55:57.808159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:49Z,data_plane_status=None,description='',device_id='fc189697-06c8-4c2b-8790-d39ee18cd896',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fad9b6dc-752f-4312-9fb4-3e5be2dec7ea,mac_address=fa:16:3e:7e:9e:05,name='',network_id=93a9ba3d-37f0-48ce-9786-b421e5404102,numa_affinity_policy=,project_id='40e631c5e320489cac9cea85118c6263',qos_network_policy_id=None,qos_policy_id=None,revision_number=3,security=PortSecurity(fad9b6dc-752f-4312-9fb4-3e5be2dec7ea),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:57Z) is not bound. Oct 09 00:55:57.808976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '52c9f24a-41b9-4582-897b-a9388e078cc4', 'device_id': 'fc189697-06c8-4c2b-8790-d39ee18cd896', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '52c9f24a-41b9-4582-897b-a9388e078cc4', 'mac_address': 'fa:16:3e:db:b9:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.235'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:55:57.817522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 95de155f-70c1-4bf8-a59a-656fdfc1f414 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:57.820812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 95de155f-70c1-4bf8-a59a-656fdfc1f414 updated. Details: {'device': '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd937102-41e7-4629-a161-cb0fb39a0995', 'network_id': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'port_id': '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'mac_address': 'fa:16:3e:ed:13:1f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'e75c4721-9fa7-417f-9e12-2a9e53f66ae7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:55:57.821728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 7 as local vlan for net-id=dd937102-41e7-4629-a161-cb0fb39a0995, seg-id=697 Oct 09 00:55:57.828290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da182d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4793), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:57.844381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363eddc,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4103)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4793}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:57.847344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap95de155f-70, col_values=(('tag', 7),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:57.847344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap95de155f-70, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:57.859774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap95de155f-70, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:57.877861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap95de155f-70, col_values=(('other_config', {'net_uuid': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '697'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:57.896224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edde,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:57.896800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: fad9b6dc-752f-4312-9fb4-3e5be2dec7ea {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:57.897474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device fad9b6dc-752f-4312-9fb4-3e5be2dec7ea not defined on plugin or binding failed Oct 09 00:55:57.898092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 52c9f24a-41b9-4582-897b-a9388e078cc4 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:55:57.898565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 52c9f24a-41b9-4582-897b-a9388e078cc4 updated. Details: {'device': '52c9f24a-41b9-4582-897b-a9388e078cc4', 'device_id': 'fc189697-06c8-4c2b-8790-d39ee18cd896', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '52c9f24a-41b9-4582-897b-a9388e078cc4', 'mac_address': 'fa:16:3e:db:b9:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.235'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:55:57.900154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52c9f24a-41, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:57.900735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-52c9f24a-41, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:57.904390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-52c9f24a-41, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:57.905018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:55:57.906726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52c9f24a-41, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:55:57.911188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:55:57.919708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ede0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:55:57.920245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:246 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.117 Oct 09 00:55:57.920921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:55:57.921358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'95de155f-70c1-4bf8-a59a-656fdfc1f414'} Oct 09 00:55:57.927050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:55:57.927535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:55:57.935442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:55:58.031062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[115cbaaa-17b1-4d4a-9081-25e84062b1af]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:55:58.034511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:55:58.034820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:55:58.037044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:55:58.037344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:55:58.047367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:55:58.111879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f48cf746-9bb0-4d38-aa27-730fdf6efef1 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:54Z,data_plane_status=None,description='',device_id='edc3da25-e74d-4384-a954-79daecb75070',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9cabf568-43d4-4d9d-bab1-324ec0901eb3,mac_address=fa:16:3e:07:87:d6,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9cabf568-43d4-4d9d-bab1-324ec0901eb3),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:58.112418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f48cf746-9bb0-4d38-aa27-730fdf6efef1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9cabf568-43d4-4d9d-bab1-324ec0901eb3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:58.161316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d6434-6f4e-44a2-b606-a7e13a289aa0]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:55:58.164315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:246 - agent port security group processed in 0.361 Oct 09 00:55:58.165076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 95de155f-70c1-4bf8-a59a-656fdfc1f414 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:55:58.165469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 52c9f24a-41b9-4582-897b-a9388e078cc4 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:55:58.304213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:58.304594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:58.483188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc7c1ee-df35-4a32-a7dc-d1d4dbea6c27 None None] Resource Port fad9b6dc-752f-4312-9fb4-3e5be2dec7ea updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fad9b6dc-752f-4312-9fb4-3e5be2dec7ea,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fad9b6dc-752f-4312-9fb4-3e5be2dec7ea,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fad9b6dc-752f-4312-9fb4-3e5be2dec7ea,segment=NetworkSegment(47eb43ca-62f0-426c-bb7d-8fbf6653ed4a),segment_id=47eb43ca-62f0-426c-bb7d-8fbf6653ed4a)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:58.483778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc7c1ee-df35-4a32-a7dc-d1d4dbea6c27 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (fad9b6dc-752f-4312-9fb4-3e5be2dec7ea), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:58.700420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49b3c24a-6c46-4dc9-ba13-d2cb40fc4350 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:57Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8ab86119-a53c-43d3-aeed-7d526b4e9475,mac_address=fa:16:3e:e9:b3:f9,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8ab86119-a53c-43d3-aeed-7d526b4e9475),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T00:55:58Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:55:58.701096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49b3c24a-6c46-4dc9-ba13-d2cb40fc4350 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8ab86119-a53c-43d3-aeed-7d526b4e9475), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:59.003666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0c5664fa-29d2-40d6-9ab3-d474199d0ccd","insert","qr-e219175f-33",["set",[]],["map",[["attached-mac","fa:16:3e:65:4f:bc"],["iface-id","e219175f-338c-47ca-ba2c-40a73c82d3b3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:59.034570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0c5664fa-29d2-40d6-9ab3-d474199d0ccd","old",null,["set",[]],null],["","new","qr-e219175f-33",12,["map",[["attached-mac","fa:16:3e:65:4f:bc"],["iface-id","e219175f-338c-47ca-ba2c-40a73c82d3b3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:55:59.051631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ba9f537-bd42-4ec0-bd68-f84175ecdba8 admin admin] Received resource Port update without any changes: e219175f-338c-47ca-ba2c-40a73c82d3b3 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 00:55:59.532452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-acdefac1-06a9-469d-886e-4e28d214f48f None None] Resource Port 95de155f-70c1-4bf8-a59a-656fdfc1f414 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:59.532875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-acdefac1-06a9-469d-886e-4e28d214f48f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (95de155f-70c1-4bf8-a59a-656fdfc1f414), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:59.843552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49b3c24a-6c46-4dc9-ba13-d2cb40fc4350 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource Port 8ab86119-a53c-43d3-aeed-7d526b4e9475 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '2141de92-7f4a-4738-8565-a90cef4cc988'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:55:59.844245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49b3c24a-6c46-4dc9-ba13-d2cb40fc4350 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8ab86119-a53c-43d3-aeed-7d526b4e9475), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:55:59.958088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0a5f9e9b-4f07-4e80-98a2-d900fa48e035","insert","qg-8f0d6bb2-ed",["set",[]],["map",[["attached-mac","fa:16:3e:92:0a:b8"],["iface-id","8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:00.000717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0a5f9e9b-4f07-4e80-98a2-d900fa48e035","old",null,["set",[]],null],["","new","qg-8f0d6bb2-ed",13,["map",[["attached-mac","fa:16:3e:92:0a:b8"],["iface-id","8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:00.695897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['95de155f-70c1-4bf8-a59a-656fdfc1f414', '52c9f24a-41b9-4582-897b-a9388e078cc4'] and devices down [] completed. Oct 09 00:56:00.696455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:246 - ports processed. Elapsed:2.924 Oct 09 00:56:00.696541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:246 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:2.925 Oct 09 00:56:00.697238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Loop iteration exceeded interval (2 vs. 2.9246907234191895)! {{(pid=107274) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 09 00:56:00.703186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:247 started Oct 09 00:56:00.708019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ede2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=28000000,duration_sec=503,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:00.709625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:00.710170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:247 - starting polling. Elapsed:0.013 Oct 09 00:56:00.713931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:00.716679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:247 - port information retrieved. Elapsed:0.019 Oct 09 00:56:00.717017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e219175f-338c-47ca-ba2c-40a73c82d3b3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'e219175f-338c-47ca-ba2c-40a73c82d3b3'}, 'removed': set(), 'updated': {'95de155f-70c1-4bf8-a59a-656fdfc1f414', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:56:00.717640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'device_id': 'fc189697-06c8-4c2b-8790-d39ee18cd896', 'network_id': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'port_id': 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'mac_address': 'fa:16:3e:7e:9e:05', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 691, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9ba14a53-0198-4c1f-9001-da2b49d70087', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:00.718124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'device_id': '2f12aa77-8149-4cd7-8101-44788eeaa82b', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'mac_address': 'fa:16:3e:92:0a:b8', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.163'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:00.718729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd937102-41e7-4629-a161-cb0fb39a0995', 'network_id': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'port_id': '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'mac_address': 'fa:16:3e:ed:13:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'e75c4721-9fa7-417f-9e12-2a9e53f66ae7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:00.719639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:55:54Z,data_plane_status=None,description='',device_id='2f12aa77-8149-4cd7-8101-44788eeaa82b',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e219175f-338c-47ca-ba2c-40a73c82d3b3,mac_address=fa:16:3e:65:4f:bc,name='',network_id=bd0c3622-3100-4974-8f51-c7c8194d1e19,numa_affinity_policy=,project_id='88e7a07d04d74e739b7fa17f73018b64',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(e219175f-338c-47ca-ba2c-40a73c82d3b3),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:55:56Z) is not bound. Oct 09 00:56:00.720206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'network_id': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'port_id': '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'mac_address': 'fa:16:3e:ea:52:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ff98a4f2-ed81-452c-99a3-cf1c43a2d01b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:00.723530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: fad9b6dc-752f-4312-9fb4-3e5be2dec7ea {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:00.723929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port fad9b6dc-752f-4312-9fb4-3e5be2dec7ea updated. Details: {'device': 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'device_id': 'fc189697-06c8-4c2b-8790-d39ee18cd896', 'network_id': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'port_id': 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'mac_address': 'fa:16:3e:7e:9e:05', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 691, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9ba14a53-0198-4c1f-9001-da2b49d70087', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 09 00:56:00.725212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fad9b6dc-75, col_values=(('tag', 4),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.726098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-fad9b6dc-75, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.727691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-fad9b6dc-75, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.748003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fad9b6dc-75, col_values=(('other_config', {'net_uuid': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '691'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.764664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ede4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:00.765202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:00.765785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 updated. Details: {'device': '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'device_id': '2f12aa77-8149-4cd7-8101-44788eeaa82b', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'mac_address': 'fa:16:3e:92:0a:b8', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.163'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:56:00.767747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-8f0d6bb2-ed, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.768544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-8f0d6bb2-ed, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.769303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-8f0d6bb2-ed, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.787701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-8f0d6bb2-ed, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.820153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ede6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:00.820703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 95de155f-70c1-4bf8-a59a-656fdfc1f414 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:00.821966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 95de155f-70c1-4bf8-a59a-656fdfc1f414 updated. Details: {'device': '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd937102-41e7-4629-a161-cb0fb39a0995', 'network_id': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'port_id': '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'mac_address': 'fa:16:3e:ed:13:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'e75c4721-9fa7-417f-9e12-2a9e53f66ae7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 09 00:56:00.824623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap95de155f-70, col_values=(('tag', 7),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.834865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap95de155f-70, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.836081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap95de155f-70, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.839632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:00.841431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap95de155f-70, col_values=(('other_config', {'net_uuid': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '697', 'tag': '7'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.846154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:00.853312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ede8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:00.855926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e219175f-338c-47ca-ba2c-40a73c82d3b3 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:00.859859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device e219175f-338c-47ca-ba2c-40a73c82d3b3 not defined on plugin or binding failed Oct 09 00:56:00.863509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:00.864070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 updated. Details: {'device': '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'network_id': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'port_id': '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'mac_address': 'fa:16:3e:ea:52:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ff98a4f2-ed81-452c-99a3-cf1c43a2d01b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 09 00:56:00.867491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a28fe29-98, col_values=(('tag', 6),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.868253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap8a28fe29-98, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.868892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap8a28fe29-98, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.871792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:00.873283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a28fe29-98, col_values=(('other_config', {'net_uuid': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '689', 'tag': '6'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:00.874175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:00.900842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edea,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:00.917936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:247 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.197 Oct 09 00:56:00.917936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 2 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:56:00.917936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'e219175f-338c-47ca-ba2c-40a73c82d3b3'} Oct 09 00:56:00.925279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:00.925577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:00.944187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:01.037799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c73528-881b-44d1-b187-5e0e00d7e59c]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:01.038705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 3 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:56:01.039226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:56:01.041778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:01.042577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:01.047929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 6 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:01.137540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e676a0-d120-46f7-960d-6eb3e4009060]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:01.138515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:247 - agent port security group processed in 0.421 Oct 09 00:56:01.140190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for fad9b6dc-752f-4312-9fb4-3e5be2dec7ea to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:01.140655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:01.141145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 95de155f-70c1-4bf8-a59a-656fdfc1f414 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:01.141579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:02.213176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port fad9b6dc-752f-4312-9fb4-3e5be2dec7ea updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:02.213785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (fad9b6dc-752f-4312-9fb4-3e5be2dec7ea), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:02.855056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:01Z,description='Default security group',id=2454485d-408a-4da5-bcfd-694483287686,is_default=True,name='default',project_id='197f7f9effc24c8eb190027e4d47cda3',revision_number=1,rules=[SecurityGroupRule(49c0196e-0632-49f7-babb-5792b1be9eee),SecurityGroupRule(cbba4aa1-f742-454e-9edd-44e11ff227cd),SecurityGroupRule(f59be7f7-b1ca-4691-bd3c-3a039b707162),SecurityGroupRule(fcb46bca-3183-4f1b-92ed-9dec4330246a)],shared=False,stateful=True,updated_at=2022-10-09T00:56:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:02.855642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (2454485d-408a-4da5-bcfd-694483287686), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:02.857014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:02Z,description=,direction='egress',ethertype='IPv4',id=49c0196e-0632-49f7-babb-5792b1be9eee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='197f7f9effc24c8eb190027e4d47cda3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2454485d-408a-4da5-bcfd-694483287686,updated_at=2022-10-09T00:56:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:02.857526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (49c0196e-0632-49f7-babb-5792b1be9eee), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:02.858001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Security group rule updated ['2454485d-408a-4da5-bcfd-694483287686'] Oct 09 00:56:02.858829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:01Z,description=,direction='ingress',ethertype='IPv4',id=cbba4aa1-f742-454e-9edd-44e11ff227cd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='197f7f9effc24c8eb190027e4d47cda3',protocol=,remote_address_group_id=,remote_group_id=2454485d-408a-4da5-bcfd-694483287686,remote_ip_prefix=,revision_number=0,security_group_id=2454485d-408a-4da5-bcfd-694483287686,updated_at=2022-10-09T00:56:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:02.859446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (cbba4aa1-f742-454e-9edd-44e11ff227cd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:02.859943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Security group rule updated ['2454485d-408a-4da5-bcfd-694483287686'] Oct 09 00:56:02.861408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:02Z,description=,direction='ingress',ethertype='IPv6',id=f59be7f7-b1ca-4691-bd3c-3a039b707162,normalized_cidr=None,port_range_max=,port_range_min=,project_id='197f7f9effc24c8eb190027e4d47cda3',protocol=,remote_address_group_id=,remote_group_id=2454485d-408a-4da5-bcfd-694483287686,remote_ip_prefix=,revision_number=0,security_group_id=2454485d-408a-4da5-bcfd-694483287686,updated_at=2022-10-09T00:56:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:02.862690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f59be7f7-b1ca-4691-bd3c-3a039b707162), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:02.863162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Security group rule updated ['2454485d-408a-4da5-bcfd-694483287686'] Oct 09 00:56:02.865293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:02Z,description=,direction='egress',ethertype='IPv6',id=fcb46bca-3183-4f1b-92ed-9dec4330246a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='197f7f9effc24c8eb190027e4d47cda3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2454485d-408a-4da5-bcfd-694483287686,updated_at=2022-10-09T00:56:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:02.867098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fcb46bca-3183-4f1b-92ed-9dec4330246a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:02.869029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9c8d4f84-6b3e-4337-931c-682a2390ec4e admin admin] Security group rule updated ['2454485d-408a-4da5-bcfd-694483287686'] Oct 09 00:56:03.022207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-174347f9-c851-4f46-aba3-9206e43ca069 None None] Resource Port 9cabf568-43d4-4d9d-bab1-324ec0901eb3 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=9cabf568-43d4-4d9d-bab1-324ec0901eb3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9cabf568-43d4-4d9d-bab1-324ec0901eb3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:03.022207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-174347f9-c851-4f46-aba3-9206e43ca069 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9cabf568-43d4-4d9d-bab1-324ec0901eb3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:03.906856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Resource SecurityGroup deleted: 2454485d-408a-4da5-bcfd-694483287686 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:03.907447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (2454485d-408a-4da5-bcfd-694483287686), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:03.908448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2454485d-408a-4da5-bcfd-694483287686',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:04.138738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-174347f9-c851-4f46-aba3-9206e43ca069 None None] Resource Port 9cabf568-43d4-4d9d-bab1-324ec0901eb3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9cabf568-43d4-4d9d-bab1-324ec0901eb3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9cabf568-43d4-4d9d-bab1-324ec0901eb3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9cabf568-43d4-4d9d-bab1-324ec0901eb3,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:04.140147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-174347f9-c851-4f46-aba3-9206e43ca069 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9cabf568-43d4-4d9d-bab1-324ec0901eb3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:04.164234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:04.165577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:04.190199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2454485d-408a-4da5-bcfd-694483287686',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:04.190795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Resource SecurityGroupRule deleted: 49c0196e-0632-49f7-babb-5792b1be9eee {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:04.191275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (49c0196e-0632-49f7-babb-5792b1be9eee), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:04.191744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Security group rule updated ['2454485d-408a-4da5-bcfd-694483287686'] Oct 09 00:56:04.192382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Resource SecurityGroupRule deleted: cbba4aa1-f742-454e-9edd-44e11ff227cd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:04.193614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (cbba4aa1-f742-454e-9edd-44e11ff227cd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:04.195166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Security group rule updated ['2454485d-408a-4da5-bcfd-694483287686'] Oct 09 00:56:04.196396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Resource SecurityGroupRule deleted: f59be7f7-b1ca-4691-bd3c-3a039b707162 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:04.198786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f59be7f7-b1ca-4691-bd3c-3a039b707162), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:04.199404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Security group rule updated ['2454485d-408a-4da5-bcfd-694483287686'] Oct 09 00:56:04.201568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Resource SecurityGroupRule deleted: fcb46bca-3183-4f1b-92ed-9dec4330246a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:04.204264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fcb46bca-3183-4f1b-92ed-9dec4330246a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:04.205483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b10b174-8cbb-4b14-995f-431093fa66f4 admin admin] Security group rule updated ['2454485d-408a-4da5-bcfd-694483287686'] Oct 09 00:56:04.494204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-88978514-0dfe-41c4-bf6c-1b41e1b8f75a admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:02Z,data_plane_status=None,description='',device_id='c529cd40-e1fc-484f-b522-0bebbee463a2',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e465dbe5-5b91-47a1-b306-617be213fe16,mac_address=fa:16:3e:d5:7e:14,name='',network_id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,numa_affinity_policy=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e465dbe5-5b91-47a1-b306-617be213fe16),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:56:03Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:04.494921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-88978514-0dfe-41c4-bf6c-1b41e1b8f75a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e465dbe5-5b91-47a1-b306-617be213fe16), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.039227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["93312759-4e32-4b1a-94c1-c69c4dbf744e","insert","qg-9cabf568-43",["set",[]],["map",[["attached-mac","fa:16:3e:07:87:d6"],["iface-id","9cabf568-43d4-4d9d-bab1-324ec0901eb3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:05.058513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["93312759-4e32-4b1a-94c1-c69c4dbf744e","old",null,["set",[]],null],["","new","qg-9cabf568-43",14,["map",[["attached-mac","fa:16:3e:07:87:d6"],["iface-id","9cabf568-43d4-4d9d-bab1-324ec0901eb3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:05.263282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:04Z,description='Default security group',id=9cf3ab7c-819c-4399-a51f-40a888ac3aae,is_default=True,name='default',project_id='c283e71634c340be94a2248f9a5f9b82',revision_number=1,rules=[SecurityGroupRule(2267da13-0443-4900-8198-c85f9f329567),SecurityGroupRule(89870e5c-1291-42f6-866d-55a8441962fa),SecurityGroupRule(bbe8b3b6-385a-4991-8db9-4f92b23b629d),SecurityGroupRule(c4ac71d4-8c7c-418d-ac34-84f745236e2b)],shared=False,stateful=True,updated_at=2022-10-09T00:56:04Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.263839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (9cf3ab7c-819c-4399-a51f-40a888ac3aae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.264885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:04Z,description=,direction='ingress',ethertype='IPv4',id=2267da13-0443-4900-8198-c85f9f329567,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c283e71634c340be94a2248f9a5f9b82',protocol=,remote_address_group_id=,remote_group_id=9cf3ab7c-819c-4399-a51f-40a888ac3aae,remote_ip_prefix=,revision_number=0,security_group_id=9cf3ab7c-819c-4399-a51f-40a888ac3aae,updated_at=2022-10-09T00:56:04Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.264885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2267da13-0443-4900-8198-c85f9f329567), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.265066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Security group rule updated ['9cf3ab7c-819c-4399-a51f-40a888ac3aae'] Oct 09 00:56:05.265743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:04Z,description=,direction='egress',ethertype='IPv4',id=89870e5c-1291-42f6-866d-55a8441962fa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c283e71634c340be94a2248f9a5f9b82',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9cf3ab7c-819c-4399-a51f-40a888ac3aae,updated_at=2022-10-09T00:56:04Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.266145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (89870e5c-1291-42f6-866d-55a8441962fa), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.266476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Security group rule updated ['9cf3ab7c-819c-4399-a51f-40a888ac3aae'] Oct 09 00:56:05.267176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:05Z,description=,direction='egress',ethertype='IPv6',id=bbe8b3b6-385a-4991-8db9-4f92b23b629d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c283e71634c340be94a2248f9a5f9b82',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9cf3ab7c-819c-4399-a51f-40a888ac3aae,updated_at=2022-10-09T00:56:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.267530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (bbe8b3b6-385a-4991-8db9-4f92b23b629d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.268008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Security group rule updated ['9cf3ab7c-819c-4399-a51f-40a888ac3aae'] Oct 09 00:56:05.270887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:04Z,description=,direction='ingress',ethertype='IPv6',id=c4ac71d4-8c7c-418d-ac34-84f745236e2b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c283e71634c340be94a2248f9a5f9b82',protocol=,remote_address_group_id=,remote_group_id=9cf3ab7c-819c-4399-a51f-40a888ac3aae,remote_ip_prefix=,revision_number=0,security_group_id=9cf3ab7c-819c-4399-a51f-40a888ac3aae,updated_at=2022-10-09T00:56:04Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.271137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c4ac71d4-8c7c-418d-ac34-84f745236e2b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.271475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-78849650-0d59-4c0a-aec9-c68922b52381 admin admin] Security group rule updated ['9cf3ab7c-819c-4399-a51f-40a888ac3aae'] Oct 09 00:56:05.312162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d9e57b7f-05e9-4b19-b6ae-d22f43f58b72 None None] Resource Port b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:05.323501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d9e57b7f-05e9-4b19-b6ae-d22f43f58b72 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.602102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Resource SecurityGroup deleted: 9cf3ab7c-819c-4399-a51f-40a888ac3aae {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:05.602489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (9cf3ab7c-819c-4399-a51f-40a888ac3aae), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.602947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9cf3ab7c-819c-4399-a51f-40a888ac3aae',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:05.804459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fad3353a-21b1-4823-a5b0-5f75ff2e3448 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:03Z,data_plane_status=None,description='',device_id='edc3da25-e74d-4384-a954-79daecb75070',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d4998b74-c67b-4a9b-8a8d-658bc5efb89b,mac_address=fa:16:3e:77:1a:42,name='',network_id=dd937102-41e7-4629-a161-cb0fb39a0995,numa_affinity_policy=,project_id='f68941040b3049bd9c62e2fc061d94c1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d4998b74-c67b-4a9b-8a8d-658bc5efb89b),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:56:04Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.805181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fad3353a-21b1-4823-a5b0-5f75ff2e3448 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d4998b74-c67b-4a9b-8a8d-658bc5efb89b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.890719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9cf3ab7c-819c-4399-a51f-40a888ac3aae',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:05.891344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Resource SecurityGroupRule deleted: 2267da13-0443-4900-8198-c85f9f329567 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:05.892285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2267da13-0443-4900-8198-c85f9f329567), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.892873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Security group rule updated ['9cf3ab7c-819c-4399-a51f-40a888ac3aae'] Oct 09 00:56:05.893345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Resource SecurityGroupRule deleted: 89870e5c-1291-42f6-866d-55a8441962fa {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:05.893839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (89870e5c-1291-42f6-866d-55a8441962fa), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.894171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Security group rule updated ['9cf3ab7c-819c-4399-a51f-40a888ac3aae'] Oct 09 00:56:05.894750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Resource SecurityGroupRule deleted: bbe8b3b6-385a-4991-8db9-4f92b23b629d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:05.895673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (bbe8b3b6-385a-4991-8db9-4f92b23b629d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.897204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Security group rule updated ['9cf3ab7c-819c-4399-a51f-40a888ac3aae'] Oct 09 00:56:05.897858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Resource SecurityGroupRule deleted: c4ac71d4-8c7c-418d-ac34-84f745236e2b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:05.898546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c4ac71d4-8c7c-418d-ac34-84f745236e2b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.899021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c7b2f45c-10ce-4184-ad58-abc5ed4e3fdc admin admin] Security group rule updated ['9cf3ab7c-819c-4399-a51f-40a888ac3aae'] Oct 09 00:56:05.963778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:05Z,description='Default security group',id=033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578,is_default=True,name='default',project_id='071e8edf3cea479baab9f37f6dd378e3',revision_number=1,rules=[SecurityGroupRule(49e748bc-4b8e-4d3a-be87-6dc43c7e4f0e),SecurityGroupRule(7c611dfc-c857-4651-ab01-b9905988e03c),SecurityGroupRule(c29dc017-9746-450c-bf19-234cf0923f5d),SecurityGroupRule(d5ed9bc9-73db-4212-bfb5-1dc6ebfd63ac)],shared=False,stateful=True,updated_at=2022-10-09T00:56:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.964684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.965687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:05Z,description=,direction='egress',ethertype='IPv6',id=49e748bc-4b8e-4d3a-be87-6dc43c7e4f0e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='071e8edf3cea479baab9f37f6dd378e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578,updated_at=2022-10-09T00:56:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.966438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (49e748bc-4b8e-4d3a-be87-6dc43c7e4f0e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.966945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Security group rule updated ['033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578'] Oct 09 00:56:05.968304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:05Z,description=,direction='ingress',ethertype='IPv4',id=7c611dfc-c857-4651-ab01-b9905988e03c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='071e8edf3cea479baab9f37f6dd378e3',protocol=,remote_address_group_id=,remote_group_id=033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578,remote_ip_prefix=,revision_number=0,security_group_id=033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578,updated_at=2022-10-09T00:56:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.968837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7c611dfc-c857-4651-ab01-b9905988e03c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.969597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Security group rule updated ['033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578'] Oct 09 00:56:05.971058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:05Z,description=,direction='egress',ethertype='IPv4',id=c29dc017-9746-450c-bf19-234cf0923f5d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='071e8edf3cea479baab9f37f6dd378e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578,updated_at=2022-10-09T00:56:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.971677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c29dc017-9746-450c-bf19-234cf0923f5d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.972448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Security group rule updated ['033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578'] Oct 09 00:56:05.973763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:05Z,description=,direction='ingress',ethertype='IPv6',id=d5ed9bc9-73db-4212-bfb5-1dc6ebfd63ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='071e8edf3cea479baab9f37f6dd378e3',protocol=,remote_address_group_id=,remote_group_id=033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578,remote_ip_prefix=,revision_number=0,security_group_id=033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578,updated_at=2022-10-09T00:56:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:05.974535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d5ed9bc9-73db-4212-bfb5-1dc6ebfd63ac), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:05.975092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4c5bbb32-e6a5-4006-b8b7-cb6f1ca03672 admin admin] Security group rule updated ['033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578'] Oct 09 00:56:06.005336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-88978514-0dfe-41c4-bf6c-1b41e1b8f75a admin admin] Received resource Port update without any changes: e465dbe5-5b91-47a1-b306-617be213fe16 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 00:56:06.902939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fad3353a-21b1-4823-a5b0-5f75ff2e3448 admin admin] Received resource Port update without any changes: d4998b74-c67b-4a9b-8a8d-658bc5efb89b {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 00:56:06.949309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', '95de155f-70c1-4bf8-a59a-656fdfc1f414', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1'] and devices down [] completed. Oct 09 00:56:06.950806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:247 - ports processed. Elapsed:6.252 Oct 09 00:56:06.951166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:247 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 3, 'removed': 0}}. Elapsed:6.254 Oct 09 00:56:06.954499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Loop iteration exceeded interval (2 vs. 6.2535436153411865)! {{(pid=107274) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 09 00:56:06.956260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:248 started Oct 09 00:56:06.962488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=281000000,duration_sec=509,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:06.963369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:06.966094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:248 - starting polling. Elapsed:0.010 Oct 09 00:56:06.973078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:06.990155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:248 - port information retrieved. Elapsed:0.035 Oct 09 00:56:06.992058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e219175f-338c-47ca-ba2c-40a73c82d3b3', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'9cabf568-43d4-4d9d-bab1-324ec0901eb3'}, 'removed': set(), 'updated': {'8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '9cabf568-43d4-4d9d-bab1-324ec0901eb3'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:56:06.994731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'device_id': '2f12aa77-8149-4cd7-8101-44788eeaa82b', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'mac_address': 'fa:16:3e:92:0a:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.163'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:06.995417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'device_id': 'fc189697-06c8-4c2b-8790-d39ee18cd896', 'network_id': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'port_id': 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'mac_address': 'fa:16:3e:7e:9e:05', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 691, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9ba14a53-0198-4c1f-9001-da2b49d70087', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:06.996254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'device_id': 'edc3da25-e74d-4384-a954-79daecb75070', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'mac_address': 'fa:16:3e:07:87:d6', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.59'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:07.005970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:07.007955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 updated. Details: {'device': '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'device_id': '2f12aa77-8149-4cd7-8101-44788eeaa82b', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'mac_address': 'fa:16:3e:92:0a:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.163'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:56:07.009796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-8f0d6bb2-ed, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.011844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-8f0d6bb2-ed, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.014370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-8f0d6bb2-ed, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.016371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:07.022742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-8f0d6bb2-ed, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.024773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:07.038145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d9e57b7f-05e9-4b19-b6ae-d22f43f58b72 None None] Resource Port b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:07.038926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d9e57b7f-05e9-4b19-b6ae-d22f43f58b72 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.054131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edee,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:07.055027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: fad9b6dc-752f-4312-9fb4-3e5be2dec7ea {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:07.056563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port fad9b6dc-752f-4312-9fb4-3e5be2dec7ea updated. Details: {'device': 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'device_id': 'fc189697-06c8-4c2b-8790-d39ee18cd896', 'network_id': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'port_id': 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'mac_address': 'fa:16:3e:7e:9e:05', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 691, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9ba14a53-0198-4c1f-9001-da2b49d70087', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 09 00:56:07.059738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fad9b6dc-75, col_values=(('tag', 4),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.061142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-fad9b6dc-75, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.062887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-fad9b6dc-75, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.063352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:07.068199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fad9b6dc-75, col_values=(('other_config', {'net_uuid': '93a9ba3d-37f0-48ce-9786-b421e5404102', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '691', 'tag': '4'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.069260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:07.077459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edf0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:07.077809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 9cabf568-43d4-4d9d-bab1-324ec0901eb3 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:07.080583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 9cabf568-43d4-4d9d-bab1-324ec0901eb3 updated. Details: {'device': '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'device_id': 'edc3da25-e74d-4384-a954-79daecb75070', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'mac_address': 'fa:16:3e:07:87:d6', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.59'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:56:07.085037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9cabf568-43, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.085872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-9cabf568-43, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.087912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-9cabf568-43, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.101197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9cabf568-43, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:07.126264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edf2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:07.127971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:248 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.135 Oct 09 00:56:07.128699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:56:07.129031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'9cabf568-43d4-4d9d-bab1-324ec0901eb3'} Oct 09 00:56:07.130728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:07.131212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:07.139054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:07.223585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6667fe-a042-4e06-bdb4-d5f586693083]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:07.224367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:56:07.224751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:56:07.226708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:07.227082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:07.232118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:07.257760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Resource SecurityGroup deleted: 033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:07.258245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.259024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:07.319118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[5053ed2f-7c19-49df-9462-62a42910ccde]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:07.320080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:248 - agent port security group processed in 0.328 Oct 09 00:56:07.321060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:07.321523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for fad9b6dc-752f-4312-9fb4-3e5be2dec7ea to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:07.321818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 9cabf568-43d4-4d9d-bab1-324ec0901eb3 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:07.620557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2be3d761-695f-4751-bd8f-22f457ac35ca None None] Resource Port e219175f-338c-47ca-ba2c-40a73c82d3b3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=e219175f-338c-47ca-ba2c-40a73c82d3b3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e219175f-338c-47ca-ba2c-40a73c82d3b3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:07.621065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2be3d761-695f-4751-bd8f-22f457ac35ca None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e219175f-338c-47ca-ba2c-40a73c82d3b3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.884773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:07.885276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Resource SecurityGroupRule deleted: 49e748bc-4b8e-4d3a-be87-6dc43c7e4f0e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:07.885650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (49e748bc-4b8e-4d3a-be87-6dc43c7e4f0e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.886122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Security group rule updated ['033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578'] Oct 09 00:56:07.886522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Resource SecurityGroupRule deleted: 7c611dfc-c857-4651-ab01-b9905988e03c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:07.886872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7c611dfc-c857-4651-ab01-b9905988e03c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.887190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Security group rule updated ['033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578'] Oct 09 00:56:07.887767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Resource SecurityGroupRule deleted: c29dc017-9746-450c-bf19-234cf0923f5d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:07.888161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c29dc017-9746-450c-bf19-234cf0923f5d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.888487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Security group rule updated ['033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578'] Oct 09 00:56:07.889127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Resource SecurityGroupRule deleted: d5ed9bc9-73db-4212-bfb5-1dc6ebfd63ac {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:07.889473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d5ed9bc9-73db-4212-bfb5-1dc6ebfd63ac), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.890718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ad27f9a6-fe02-438e-94ac-a30397f055ba admin admin] Security group rule updated ['033ceefd-ba8b-4fd6-a9d9-1a83cc2b7578'] Oct 09 00:56:07.917658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:06Z,description='Default security group',id=96da09b2-631c-4ecf-9471-3237be3b814d,is_default=True,name='default',project_id='54e1d6edeaa7407db1d7c18065755428',revision_number=1,rules=[SecurityGroupRule(25551278-eef6-4f0d-9b2e-8544a5617682),SecurityGroupRule(52142460-464a-41bc-b747-996f62d97022),SecurityGroupRule(99543c4e-4a09-419c-b510-d92348d7ef6a),SecurityGroupRule(fcb22430-627e-4398-9fb0-bbef3e54d78d)],shared=False,stateful=True,updated_at=2022-10-09T00:56:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:07.919191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (96da09b2-631c-4ecf-9471-3237be3b814d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.920398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:07Z,description=,direction='ingress',ethertype='IPv4',id=25551278-eef6-4f0d-9b2e-8544a5617682,normalized_cidr=None,port_range_max=,port_range_min=,project_id='54e1d6edeaa7407db1d7c18065755428',protocol=,remote_address_group_id=,remote_group_id=96da09b2-631c-4ecf-9471-3237be3b814d,remote_ip_prefix=,revision_number=0,security_group_id=96da09b2-631c-4ecf-9471-3237be3b814d,updated_at=2022-10-09T00:56:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:07.926605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (25551278-eef6-4f0d-9b2e-8544a5617682), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.926967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Security group rule updated ['96da09b2-631c-4ecf-9471-3237be3b814d'] Oct 09 00:56:07.928082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:07Z,description=,direction='egress',ethertype='IPv4',id=52142460-464a-41bc-b747-996f62d97022,normalized_cidr=None,port_range_max=,port_range_min=,project_id='54e1d6edeaa7407db1d7c18065755428',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=96da09b2-631c-4ecf-9471-3237be3b814d,updated_at=2022-10-09T00:56:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:07.928414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (52142460-464a-41bc-b747-996f62d97022), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.934836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Security group rule updated ['96da09b2-631c-4ecf-9471-3237be3b814d'] Oct 09 00:56:07.935831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:07Z,description=,direction='ingress',ethertype='IPv6',id=99543c4e-4a09-419c-b510-d92348d7ef6a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='54e1d6edeaa7407db1d7c18065755428',protocol=,remote_address_group_id=,remote_group_id=96da09b2-631c-4ecf-9471-3237be3b814d,remote_ip_prefix=,revision_number=0,security_group_id=96da09b2-631c-4ecf-9471-3237be3b814d,updated_at=2022-10-09T00:56:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:07.936221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (99543c4e-4a09-419c-b510-d92348d7ef6a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.940358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Security group rule updated ['96da09b2-631c-4ecf-9471-3237be3b814d'] Oct 09 00:56:07.940358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:07Z,description=,direction='egress',ethertype='IPv6',id=fcb22430-627e-4398-9fb0-bbef3e54d78d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='54e1d6edeaa7407db1d7c18065755428',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=96da09b2-631c-4ecf-9471-3237be3b814d,updated_at=2022-10-09T00:56:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:07.940594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fcb22430-627e-4398-9fb0-bbef3e54d78d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:07.944914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2ca0d398-1424-4735-8dd2-b32465682f17 admin admin] Security group rule updated ['96da09b2-631c-4ecf-9471-3237be3b814d'] Oct 09 00:56:08.417842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Resource SecurityGroup deleted: 96da09b2-631c-4ecf-9471-3237be3b814d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:08.418649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (96da09b2-631c-4ecf-9471-3237be3b814d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:08.419253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('96da09b2-631c-4ecf-9471-3237be3b814d',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:08.726079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bee50a57-f7d7-4cd4-9542-82eff7682860 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:08Z,description='tempest-description--1147889779',id=777936c7-14aa-4727-901f-85cc3efdcde9,is_default=False,name='tempest-securitygroup--527263532',project_id='a7d8e82f58814da6b8c08bfa04955d4c',revision_number=1,rules=[SecurityGroupRule(0a552fa0-502b-46a8-8fd1-3d4ec162add0),SecurityGroupRule(f96c67fe-1914-498a-8272-56a96b5d1697)],shared=False,stateful=True,updated_at=2022-10-09T00:56:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:08.726382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bee50a57-f7d7-4cd4-9542-82eff7682860 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (777936c7-14aa-4727-901f-85cc3efdcde9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:08.727008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bee50a57-f7d7-4cd4-9542-82eff7682860 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:08Z,description=,direction='egress',ethertype='IPv6',id=0a552fa0-502b-46a8-8fd1-3d4ec162add0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=777936c7-14aa-4727-901f-85cc3efdcde9,updated_at=2022-10-09T00:56:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:08.727367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bee50a57-f7d7-4cd4-9542-82eff7682860 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0a552fa0-502b-46a8-8fd1-3d4ec162add0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:08.727946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bee50a57-f7d7-4cd4-9542-82eff7682860 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['777936c7-14aa-4727-901f-85cc3efdcde9'] Oct 09 00:56:08.729072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bee50a57-f7d7-4cd4-9542-82eff7682860 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:08Z,description=,direction='egress',ethertype='IPv4',id=f96c67fe-1914-498a-8272-56a96b5d1697,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=777936c7-14aa-4727-901f-85cc3efdcde9,updated_at=2022-10-09T00:56:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:08.729589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bee50a57-f7d7-4cd4-9542-82eff7682860 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f96c67fe-1914-498a-8272-56a96b5d1697), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:08.730106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bee50a57-f7d7-4cd4-9542-82eff7682860 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['777936c7-14aa-4727-901f-85cc3efdcde9'] Oct 09 00:56:08.733072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('96da09b2-631c-4ecf-9471-3237be3b814d',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:08.733740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Resource SecurityGroupRule deleted: 25551278-eef6-4f0d-9b2e-8544a5617682 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:08.735231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (25551278-eef6-4f0d-9b2e-8544a5617682), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:08.739820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Security group rule updated ['96da09b2-631c-4ecf-9471-3237be3b814d'] Oct 09 00:56:08.740531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Resource SecurityGroupRule deleted: 52142460-464a-41bc-b747-996f62d97022 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:08.743143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (52142460-464a-41bc-b747-996f62d97022), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:08.743727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Security group rule updated ['96da09b2-631c-4ecf-9471-3237be3b814d'] Oct 09 00:56:08.746450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Resource SecurityGroupRule deleted: 99543c4e-4a09-419c-b510-d92348d7ef6a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:08.748715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (99543c4e-4a09-419c-b510-d92348d7ef6a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:08.749682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Security group rule updated ['96da09b2-631c-4ecf-9471-3237be3b814d'] Oct 09 00:56:08.752984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Resource SecurityGroupRule deleted: fcb22430-627e-4398-9fb0-bbef3e54d78d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:08.753573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fcb22430-627e-4398-9fb0-bbef3e54d78d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:08.754543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff7c2465-8694-4e2f-a06d-3f6cc9e46103 admin admin] Security group rule updated ['96da09b2-631c-4ecf-9471-3237be3b814d'] Oct 09 00:56:09.033962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2be3d761-695f-4751-bd8f-22f457ac35ca None None] Resource Port e219175f-338c-47ca-ba2c-40a73c82d3b3 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e219175f-338c-47ca-ba2c-40a73c82d3b3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e219175f-338c-47ca-ba2c-40a73c82d3b3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e219175f-338c-47ca-ba2c-40a73c82d3b3,segment=NetworkSegment(21f1d887-4a9b-4110-9ac3-3d69ca77915d),segment_id=21f1d887-4a9b-4110-9ac3-3d69ca77915d)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:09.034624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2be3d761-695f-4751-bd8f-22f457ac35ca None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e219175f-338c-47ca-ba2c-40a73c82d3b3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:10.154731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e2ed203d-6bbf-4553-8477-7329b925cc99","insert","qr-e465dbe5-5b",["set",[]],["map",[["attached-mac","fa:16:3e:d5:7e:14"],["iface-id","e465dbe5-5b91-47a1-b306-617be213fe16"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:10.178475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e2ed203d-6bbf-4553-8477-7329b925cc99","old",null,["set",[]],null],["","new","qr-e465dbe5-5b",15,["map",[["attached-mac","fa:16:3e:d5:7e:14"],["iface-id","e465dbe5-5b91-47a1-b306-617be213fe16"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:10.405210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3d5c181b-7088-40d0-a59a-3576974eee5d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:09Z,description='',direction='ingress',ethertype='IPv4',id=b7986354-8c90-4491-b3a5-558c4ef44ab5,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=777936c7-14aa-4727-901f-85cc3efdcde9,updated_at=2022-10-09T00:56:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:10.405604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3d5c181b-7088-40d0-a59a-3576974eee5d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b7986354-8c90-4491-b3a5-558c4ef44ab5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:10.406010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3d5c181b-7088-40d0-a59a-3576974eee5d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['777936c7-14aa-4727-901f-85cc3efdcde9'] Oct 09 00:56:10.807152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '9cabf568-43d4-4d9d-bab1-324ec0901eb3'] and devices down [] completed. Oct 09 00:56:10.807728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:248 - ports processed. Elapsed:3.853 Oct 09 00:56:10.808374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:248 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:3.853 Oct 09 00:56:10.809218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Loop iteration exceeded interval (2 vs. 3.8533198833465576)! {{(pid=107274) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 09 00:56:10.809648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:249 started Oct 09 00:56:10.813895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edf4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=133000000,duration_sec=513,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:10.815310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:10.816016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:249 - starting polling. Elapsed:0.006 Oct 09 00:56:10.818351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:10.833486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:249 - port information retrieved. Elapsed:0.024 Oct 09 00:56:10.835999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'e465dbe5-5b91-47a1-b306-617be213fe16'}, 'removed': set(), 'updated': {'e219175f-338c-47ca-ba2c-40a73c82d3b3'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:56:10.838321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'device_id': '2f12aa77-8149-4cd7-8101-44788eeaa82b', 'network_id': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'port_id': 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'mac_address': 'fa:16:3e:65:4f:bc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a548fa97-cb20-45d6-8da8-0556662605e1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:10.843490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:02Z,data_plane_status=None,description='',device_id='c529cd40-e1fc-484f-b522-0bebbee463a2',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e465dbe5-5b91-47a1-b306-617be213fe16,mac_address=fa:16:3e:d5:7e:14,name='',network_id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,numa_affinity_policy=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(e465dbe5-5b91-47a1-b306-617be213fe16),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:56:05Z) is not bound. Oct 09 00:56:10.883309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e219175f-338c-47ca-ba2c-40a73c82d3b3 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:10.884298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e219175f-338c-47ca-ba2c-40a73c82d3b3 updated. Details: {'device': 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'device_id': '2f12aa77-8149-4cd7-8101-44788eeaa82b', 'network_id': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'port_id': 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'mac_address': 'fa:16:3e:65:4f:bc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a548fa97-cb20-45d6-8da8-0556662605e1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 09 00:56:10.890949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e219175f-33, col_values=(('tag', 5),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:10.893383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-e219175f-33, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:10.895432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-e219175f-33, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:10.929650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e219175f-33, col_values=(('other_config', {'net_uuid': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '657'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:10.966577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edf6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:10.970674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e465dbe5-5b91-47a1-b306-617be213fe16 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:10.977300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device e465dbe5-5b91-47a1-b306-617be213fe16 not defined on plugin or binding failed Oct 09 00:56:10.978177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:249 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.142 Oct 09 00:56:10.980806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:56:10.981358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'e465dbe5-5b91-47a1-b306-617be213fe16'} Oct 09 00:56:10.987713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:10.988385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:11.032070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:56:11.044010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:56:11.046889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:11.051625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:11.096366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:11.105031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 9cabf568-43d4-4d9d-bab1-324ec0901eb3 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9cabf568-43d4-4d9d-bab1-324ec0901eb3,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9cabf568-43d4-4d9d-bab1-324ec0901eb3,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:11.114940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9cabf568-43d4-4d9d-bab1-324ec0901eb3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:11.205896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c14668c-69f6-4680-9d6e-bd11fded184e]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:11.206577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:249 - agent port security group processed in 0.370 Oct 09 00:56:11.207903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for e219175f-338c-47ca-ba2c-40a73c82d3b3 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:11.577888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd177d3b-1e14-4dd0-8151-16912ff46b55 None None] Resource Port d4998b74-c67b-4a9b-8a8d-658bc5efb89b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=d4998b74-c67b-4a9b-8a8d-658bc5efb89b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d4998b74-c67b-4a9b-8a8d-658bc5efb89b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:11.578363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd177d3b-1e14-4dd0-8151-16912ff46b55 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d4998b74-c67b-4a9b-8a8d-658bc5efb89b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:11.598789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["26c2998e-8dce-482f-be10-aa8c60ea3cb6","insert","qg-b33db3c4-e8",["set",[]],["map",[["attached-mac","fa:16:3e:fd:41:e9"],["iface-id","b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:11.633640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["26c2998e-8dce-482f-be10-aa8c60ea3cb6","old",null,["set",[]],null],["","new","qg-b33db3c4-e8",16,["map",[["attached-mac","fa:16:3e:fd:41:e9"],["iface-id","b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:12.008904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['e219175f-338c-47ca-ba2c-40a73c82d3b3'] and devices down [] completed. Oct 09 00:56:12.009474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:249 - ports processed. Elapsed:1.200 Oct 09 00:56:12.009991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:249 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.200 Oct 09 00:56:12.154308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:10Z,description='Default security group',id=3fc607cc-7292-4446-8eec-be3ab946f784,is_default=True,name='default',project_id='46dad7bb16e340d9b0e65ac40a615b91',revision_number=1,rules=[SecurityGroupRule(aadf3bff-30c9-4de8-98a8-81113bf37b7a),SecurityGroupRule(dff1940b-b9d6-415a-8994-29bc4aa229b7),SecurityGroupRule(e07b0ac5-7d82-47fd-b220-304eaaccdb8c),SecurityGroupRule(e1fe9886-3eb5-4a43-bae1-187518939203)],shared=False,stateful=True,updated_at=2022-10-09T00:56:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:12.155386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (3fc607cc-7292-4446-8eec-be3ab946f784), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.156286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:10Z,description=,direction='ingress',ethertype='IPv6',id=aadf3bff-30c9-4de8-98a8-81113bf37b7a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46dad7bb16e340d9b0e65ac40a615b91',protocol=,remote_address_group_id=,remote_group_id=3fc607cc-7292-4446-8eec-be3ab946f784,remote_ip_prefix=,revision_number=0,security_group_id=3fc607cc-7292-4446-8eec-be3ab946f784,updated_at=2022-10-09T00:56:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:12.156760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (aadf3bff-30c9-4de8-98a8-81113bf37b7a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.157226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Security group rule updated ['3fc607cc-7292-4446-8eec-be3ab946f784'] Oct 09 00:56:12.158483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:10Z,description=,direction='egress',ethertype='IPv4',id=dff1940b-b9d6-415a-8994-29bc4aa229b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46dad7bb16e340d9b0e65ac40a615b91',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3fc607cc-7292-4446-8eec-be3ab946f784,updated_at=2022-10-09T00:56:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:12.159222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (dff1940b-b9d6-415a-8994-29bc4aa229b7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.159958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Security group rule updated ['3fc607cc-7292-4446-8eec-be3ab946f784'] Oct 09 00:56:12.160600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:10Z,description=,direction='egress',ethertype='IPv6',id=e07b0ac5-7d82-47fd-b220-304eaaccdb8c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46dad7bb16e340d9b0e65ac40a615b91',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3fc607cc-7292-4446-8eec-be3ab946f784,updated_at=2022-10-09T00:56:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:12.162083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e07b0ac5-7d82-47fd-b220-304eaaccdb8c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.162436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Security group rule updated ['3fc607cc-7292-4446-8eec-be3ab946f784'] Oct 09 00:56:12.167027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:10Z,description=,direction='ingress',ethertype='IPv4',id=e1fe9886-3eb5-4a43-bae1-187518939203,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46dad7bb16e340d9b0e65ac40a615b91',protocol=,remote_address_group_id=,remote_group_id=3fc607cc-7292-4446-8eec-be3ab946f784,remote_ip_prefix=,revision_number=0,security_group_id=3fc607cc-7292-4446-8eec-be3ab946f784,updated_at=2022-10-09T00:56:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:12.170558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e1fe9886-3eb5-4a43-bae1-187518939203), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.171980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ecc72630-42a5-4371-b02b-7c2bc622007a admin admin] Security group rule updated ['3fc607cc-7292-4446-8eec-be3ab946f784'] Oct 09 00:56:12.267825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port e219175f-338c-47ca-ba2c-40a73c82d3b3 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:12.268667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e219175f-338c-47ca-ba2c-40a73c82d3b3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.429302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-65f26122-a66c-4d08-babb-5db0dcc4a003 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:11Z,description='',direction='ingress',ethertype='IPv4',id=737dd766-45d2-4f25-9b85-9ce89fe0e1e3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=777936c7-14aa-4727-901f-85cc3efdcde9,updated_at=2022-10-09T00:56:11Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:12.430394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-65f26122-a66c-4d08-babb-5db0dcc4a003 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (737dd766-45d2-4f25-9b85-9ce89fe0e1e3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.431018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-65f26122-a66c-4d08-babb-5db0dcc4a003 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['777936c7-14aa-4727-901f-85cc3efdcde9'] Oct 09 00:56:12.541968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd177d3b-1e14-4dd0-8151-16912ff46b55 None None] Resource Port d4998b74-c67b-4a9b-8a8d-658bc5efb89b updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d4998b74-c67b-4a9b-8a8d-658bc5efb89b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d4998b74-c67b-4a9b-8a8d-658bc5efb89b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d4998b74-c67b-4a9b-8a8d-658bc5efb89b,segment=NetworkSegment(8baf8725-752c-48bf-80b5-a9b2d3636b8e),segment_id=8baf8725-752c-48bf-80b5-a9b2d3636b8e)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:12.542536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd177d3b-1e14-4dd0-8151-16912ff46b55 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d4998b74-c67b-4a9b-8a8d-658bc5efb89b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.812115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:250 started Oct 09 00:56:12.816530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363edf8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=136000000,duration_sec=515,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:12.817386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:12.818821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:250 - starting polling. Elapsed:0.007 Oct 09 00:56:12.842133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:12.870322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:250 - port information retrieved. Elapsed:0.052 Oct 09 00:56:12.880002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2'}, 'removed': set(), 'updated': {'e219175f-338c-47ca-ba2c-40a73c82d3b3', '9cabf568-43d4-4d9d-bab1-324ec0901eb3'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:56:12.885039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'device_id': '2f12aa77-8149-4cd7-8101-44788eeaa82b', 'network_id': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'port_id': 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'mac_address': 'fa:16:3e:65:4f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a548fa97-cb20-45d6-8da8-0556662605e1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:12.885642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'device_id': 'c529cd40-e1fc-484f-b522-0bebbee463a2', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'mac_address': 'fa:16:3e:fd:41:e9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.141'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:12.886077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'device_id': 'edc3da25-e74d-4384-a954-79daecb75070', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'mac_address': 'fa:16:3e:07:87:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.59'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:12.901609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e219175f-338c-47ca-ba2c-40a73c82d3b3 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:12.902316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e219175f-338c-47ca-ba2c-40a73c82d3b3 updated. Details: {'device': 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'device_id': '2f12aa77-8149-4cd7-8101-44788eeaa82b', 'network_id': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'port_id': 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'mac_address': 'fa:16:3e:65:4f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a548fa97-cb20-45d6-8da8-0556662605e1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 09 00:56:12.905711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e219175f-33, col_values=(('tag', 5),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:12.908043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-e219175f-33, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:12.910299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-e219175f-33, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:12.912770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:12.927746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e219175f-33, col_values=(('other_config', {'net_uuid': 'bd0c3622-3100-4974-8f51-c7c8194d1e19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '657', 'tag': '5'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:12.931522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:12.940666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edfa,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:12.942442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:12.943793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 updated. Details: {'device': 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'device_id': 'c529cd40-e1fc-484f-b522-0bebbee463a2', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'mac_address': 'fa:16:3e:fd:41:e9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.141'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:56:12.947386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b33db3c4-e8, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:12.949532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-b33db3c4-e8, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:12.950183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-b33db3c4-e8, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:12.968890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b33db3c4-e8, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:13.010162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edfc,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:13.010589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 9cabf568-43d4-4d9d-bab1-324ec0901eb3 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:13.010920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 9cabf568-43d4-4d9d-bab1-324ec0901eb3 updated. Details: {'device': '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'device_id': 'edc3da25-e74d-4384-a954-79daecb75070', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'mac_address': 'fa:16:3e:07:87:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.59'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:56:13.046392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9cabf568-43, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:13.047353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-9cabf568-43, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:13.049891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-9cabf568-43, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:13.051805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:13.053813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9cabf568-43, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:13.066072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:13.080490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363edfe,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:13.083394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:250 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.203 Oct 09 00:56:13.085465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:56:13.088970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2'} Oct 09 00:56:13.094631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:13.095922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:13.116427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:13.258555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-08539a9d-85ff-46d7-9289-8b6981f71461 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:08Z,data_plane_status=None,description='',device_id='3247d2ef-8e30-4cee-b097-1957a0a3de81',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=035fc085-892c-4866-9ff4-6bd3d7193e9b,mac_address=fa:16:3e:24:e8:c4,name='',network_id=93a9ba3d-37f0-48ce-9786-b421e5404102,numa_affinity_policy=,project_id='40e631c5e320489cac9cea85118c6263',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(035fc085-892c-4866-9ff4-6bd3d7193e9b),security_group_ids=set([40866277-1b5e-448e-aa7a-22cc7be390c9]),status='DOWN',updated_at=2022-10-09T00:56:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:13.259154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-08539a9d-85ff-46d7-9289-8b6981f71461 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (035fc085-892c-4866-9ff4-6bd3d7193e9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:13.259806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-08539a9d-85ff-46d7-9289-8b6981f71461 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group member updated {'40866277-1b5e-448e-aa7a-22cc7be390c9'} Oct 09 00:56:13.302053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3a3689-bee7-44b8-bfaa-d3c36f2afc5a]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:13.302793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:56:13.302938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:56:13.305131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:13.305813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:13.317762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:13.331272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Resource SecurityGroup deleted: 3fc607cc-7292-4446-8eec-be3ab946f784 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:13.331272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (3fc607cc-7292-4446-8eec-be3ab946f784), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:13.331514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3fc607cc-7292-4446-8eec-be3ab946f784',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:13.384905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3fc607cc-7292-4446-8eec-be3ab946f784',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:13.385631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Resource SecurityGroupRule deleted: aadf3bff-30c9-4de8-98a8-81113bf37b7a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:13.386781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (aadf3bff-30c9-4de8-98a8-81113bf37b7a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:13.387533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Security group rule updated ['3fc607cc-7292-4446-8eec-be3ab946f784'] Oct 09 00:56:13.457455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f56b08-eec2-4d21-b096-63c4f10841c8]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:13.458314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:250 - agent port security group processed in 0.578 Oct 09 00:56:13.459637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for e219175f-338c-47ca-ba2c-40a73c82d3b3 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:13.460360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:13.460798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 9cabf568-43d4-4d9d-bab1-324ec0901eb3 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:13.469114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Resource SecurityGroupRule deleted: dff1940b-b9d6-415a-8994-29bc4aa229b7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:13.469498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (dff1940b-b9d6-415a-8994-29bc4aa229b7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:13.477877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Security group rule updated ['3fc607cc-7292-4446-8eec-be3ab946f784'] Oct 09 00:56:13.478459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Resource SecurityGroupRule deleted: e07b0ac5-7d82-47fd-b220-304eaaccdb8c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:13.480340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e07b0ac5-7d82-47fd-b220-304eaaccdb8c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:13.480756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Security group rule updated ['3fc607cc-7292-4446-8eec-be3ab946f784'] Oct 09 00:56:13.481154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Resource SecurityGroupRule deleted: e1fe9886-3eb5-4a43-bae1-187518939203 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:13.481516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e1fe9886-3eb5-4a43-bae1-187518939203), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:13.482622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03ab8f1b-4890-4b12-93f0-6f42c70dc480 admin admin] Security group rule updated ['3fc607cc-7292-4446-8eec-be3ab946f784'] Oct 09 00:56:13.682793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5e7fa104-fbde-42fa-8798-844378a577cf","insert","qr-d4998b74-c6",["set",[]],["map",[["attached-mac","fa:16:3e:77:1a:42"],["iface-id","d4998b74-c67b-4a9b-8a8d-658bc5efb89b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:13.701126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-23e0cf56-2eec-4809-84ce-25de61cd328f tempest-DeleteServersTestJSON-718467185 tempest-DeleteServersTestJSON-718467185-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:10Z,data_plane_status=None,description='',device_id='e59fb8b2-1822-415f-8c7c-f398d24da057',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=afb80013-2258-4db2-b056-f0c814dfdeed,mac_address=fa:16:3e:c5:27:6f,name='',network_id=bd0c3622-3100-4974-8f51-c7c8194d1e19,numa_affinity_policy=,project_id='88e7a07d04d74e739b7fa17f73018b64',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(afb80013-2258-4db2-b056-f0c814dfdeed),security_group_ids=set([5ca2704a-36a6-44be-843b-b3c729b1a9d0]),status='DOWN',updated_at=2022-10-09T00:56:11Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:13.709093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-23e0cf56-2eec-4809-84ce-25de61cd328f tempest-DeleteServersTestJSON-718467185 tempest-DeleteServersTestJSON-718467185-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (afb80013-2258-4db2-b056-f0c814dfdeed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:13.709694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-23e0cf56-2eec-4809-84ce-25de61cd328f tempest-DeleteServersTestJSON-718467185 tempest-DeleteServersTestJSON-718467185-project] Security group member updated {'5ca2704a-36a6-44be-843b-b3c729b1a9d0'} Oct 09 00:56:13.710737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5e7fa104-fbde-42fa-8798-844378a577cf","old",null,["set",[]],null],["","new","qr-d4998b74-c6",17,["map",[["attached-mac","fa:16:3e:77:1a:42"],["iface-id","d4998b74-c67b-4a9b-8a8d-658bc5efb89b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:56:15.468999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f1270628-8c9d-4083-96c9-a61ea7bc7b1d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:13Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ad40b227-899e-4d0c-a7ae-011b3f93ab4f,mac_address=fa:16:3e:51:37:6a,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ad40b227-899e-4d0c-a7ae-011b3f93ab4f),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T00:56:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:15.470725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f1270628-8c9d-4083-96c9-a61ea7bc7b1d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ad40b227-899e-4d0c-a7ae-011b3f93ab4f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:15.980071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:15.981048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.082083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:14Z,description='Default security group',id=3ebd8145-30ec-4caa-b107-71236aac2a4a,is_default=True,name='default',project_id='28e69a2efede4f4a834de16f5712ec2e',revision_number=1,rules=[SecurityGroupRule(426385d4-b4b6-43ea-bf1e-71f9b2af115e),SecurityGroupRule(704cd6b3-c5fc-4ece-9432-591aa98858ac),SecurityGroupRule(b744c547-b419-4ee0-8391-9f1f3a0f2374),SecurityGroupRule(bfdd3d76-a86f-4de5-a568-7d8e722a4911)],shared=False,stateful=True,updated_at=2022-10-09T00:56:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:16.086720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (3ebd8145-30ec-4caa-b107-71236aac2a4a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.089631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:15Z,description=,direction='ingress',ethertype='IPv6',id=426385d4-b4b6-43ea-bf1e-71f9b2af115e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28e69a2efede4f4a834de16f5712ec2e',protocol=,remote_address_group_id=,remote_group_id=3ebd8145-30ec-4caa-b107-71236aac2a4a,remote_ip_prefix=,revision_number=0,security_group_id=3ebd8145-30ec-4caa-b107-71236aac2a4a,updated_at=2022-10-09T00:56:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:16.090200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (426385d4-b4b6-43ea-bf1e-71f9b2af115e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.093356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Security group rule updated ['3ebd8145-30ec-4caa-b107-71236aac2a4a'] Oct 09 00:56:16.096808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:15Z,description=,direction='ingress',ethertype='IPv4',id=704cd6b3-c5fc-4ece-9432-591aa98858ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28e69a2efede4f4a834de16f5712ec2e',protocol=,remote_address_group_id=,remote_group_id=3ebd8145-30ec-4caa-b107-71236aac2a4a,remote_ip_prefix=,revision_number=0,security_group_id=3ebd8145-30ec-4caa-b107-71236aac2a4a,updated_at=2022-10-09T00:56:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:16.097976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (704cd6b3-c5fc-4ece-9432-591aa98858ac), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.102882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Security group rule updated ['3ebd8145-30ec-4caa-b107-71236aac2a4a'] Oct 09 00:56:16.103858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:15Z,description=,direction='egress',ethertype='IPv4',id=b744c547-b419-4ee0-8391-9f1f3a0f2374,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28e69a2efede4f4a834de16f5712ec2e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3ebd8145-30ec-4caa-b107-71236aac2a4a,updated_at=2022-10-09T00:56:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:16.105540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b744c547-b419-4ee0-8391-9f1f3a0f2374), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.108637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Security group rule updated ['3ebd8145-30ec-4caa-b107-71236aac2a4a'] Oct 09 00:56:16.110531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:15Z,description=,direction='egress',ethertype='IPv6',id=bfdd3d76-a86f-4de5-a568-7d8e722a4911,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28e69a2efede4f4a834de16f5712ec2e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3ebd8145-30ec-4caa-b107-71236aac2a4a,updated_at=2022-10-09T00:56:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:16.116115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (bfdd3d76-a86f-4de5-a568-7d8e722a4911), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.122008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-671765ca-5a63-4aba-9ed2-1c343b1f1d98 admin admin] Security group rule updated ['3ebd8145-30ec-4caa-b107-71236aac2a4a'] Oct 09 00:56:16.583679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['e219175f-338c-47ca-ba2c-40a73c82d3b3', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '9cabf568-43d4-4d9d-bab1-324ec0901eb3'] and devices down [] completed. Oct 09 00:56:16.584684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:250 - ports processed. Elapsed:3.773 Oct 09 00:56:16.585201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:250 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:3.773 Oct 09 00:56:16.586564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Loop iteration exceeded interval (2 vs. 3.773237466812134)! {{(pid=107274) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 09 00:56:16.587015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:251 started Oct 09 00:56:16.593237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=910000000,duration_sec=518,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:16.594465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:16.596373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:251 - starting polling. Elapsed:0.009 Oct 09 00:56:16.598996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.611891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:251 - port information retrieved. Elapsed:0.025 Oct 09 00:56:16.616219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e219175f-338c-47ca-ba2c-40a73c82d3b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'d4998b74-c67b-4a9b-8a8d-658bc5efb89b'}, 'removed': set(), 'updated': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:56:16.617016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'device_id': 'edc3da25-e74d-4384-a954-79daecb75070', 'network_id': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'port_id': 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'mac_address': 'fa:16:3e:77:1a:42', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'e75c4721-9fa7-417f-9e12-2a9e53f66ae7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:16.617705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'device_id': 'c529cd40-e1fc-484f-b522-0bebbee463a2', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'mac_address': 'fa:16:3e:fd:41:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.141'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:16.621803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: d4998b74-c67b-4a9b-8a8d-658bc5efb89b {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:16.625007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port d4998b74-c67b-4a9b-8a8d-658bc5efb89b updated. Details: {'device': 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'device_id': 'edc3da25-e74d-4384-a954-79daecb75070', 'network_id': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'port_id': 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'mac_address': 'fa:16:3e:77:1a:42', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'e75c4721-9fa7-417f-9e12-2a9e53f66ae7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 09 00:56:16.628803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d4998b74-c6, col_values=(('tag', 7),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:16.631318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d4998b74-c6, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:16.632608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d4998b74-c6, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:16.649831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d4998b74-c6, col_values=(('other_config', {'net_uuid': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '697'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:16.676681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee02,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:16.677137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:16.677781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 updated. Details: {'device': 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'device_id': 'c529cd40-e1fc-484f-b522-0bebbee463a2', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'mac_address': 'fa:16:3e:fd:41:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.141'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:56:16.678682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b33db3c4-e8, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:16.683011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-b33db3c4-e8, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:16.683462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-b33db3c4-e8, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:16.683858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:16.685415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b33db3c4-e8, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:16.690755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:16.704102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee04,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:16.705262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:251 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.088 Oct 09 00:56:16.705640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:56:16.705934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'d4998b74-c67b-4a9b-8a8d-658bc5efb89b'} Oct 09 00:56:16.709271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:16.709627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:16.726258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:16.800418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Resource SecurityGroup deleted: 3ebd8145-30ec-4caa-b107-71236aac2a4a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:16.800789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (3ebd8145-30ec-4caa-b107-71236aac2a4a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.801243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3ebd8145-30ec-4caa-b107-71236aac2a4a',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:16.874464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb167010-349c-457d-9a17-395c5c4857fa]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:16.875419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:56:16.876025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:56:16.878412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:16.878831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:16.886642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:16.917644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3ebd8145-30ec-4caa-b107-71236aac2a4a',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:16.918136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Resource SecurityGroupRule deleted: 426385d4-b4b6-43ea-bf1e-71f9b2af115e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:16.918571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (426385d4-b4b6-43ea-bf1e-71f9b2af115e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.919057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Security group rule updated ['3ebd8145-30ec-4caa-b107-71236aac2a4a'] Oct 09 00:56:16.989894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a910b-4165-457c-84bc-b5108ded1c7a]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:16.991203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:251 - agent port security group processed in 0.374 Oct 09 00:56:16.992200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for d4998b74-c67b-4a9b-8a8d-658bc5efb89b to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:16.992871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:16.996260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Resource SecurityGroupRule deleted: 704cd6b3-c5fc-4ece-9432-591aa98858ac {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:16.996844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (704cd6b3-c5fc-4ece-9432-591aa98858ac), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.997330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Security group rule updated ['3ebd8145-30ec-4caa-b107-71236aac2a4a'] Oct 09 00:56:16.998234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Resource SecurityGroupRule deleted: b744c547-b419-4ee0-8391-9f1f3a0f2374 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:16.998734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b744c547-b419-4ee0-8391-9f1f3a0f2374), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:16.999220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Security group rule updated ['3ebd8145-30ec-4caa-b107-71236aac2a4a'] Oct 09 00:56:16.999778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Resource SecurityGroupRule deleted: bfdd3d76-a86f-4de5-a568-7d8e722a4911 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:17.000280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (bfdd3d76-a86f-4de5-a568-7d8e722a4911), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:17.003420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a69302a0-a362-4254-90e3-a847cb9fa790 admin admin] Security group rule updated ['3ebd8145-30ec-4caa-b107-71236aac2a4a'] Oct 09 00:56:17.865346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6c90b896-35a9-4424-b2c2-82fbb1b03b39 service neutron] Resource Port afb80013-2258-4db2-b056-f0c814dfdeed updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=afb80013-2258-4db2-b056-f0c814dfdeed,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=afb80013-2258-4db2-b056-f0c814dfdeed,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:17.866758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6c90b896-35a9-4424-b2c2-82fbb1b03b39 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (afb80013-2258-4db2-b056-f0c814dfdeed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:18.068533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port d4998b74-c67b-4a9b-8a8d-658bc5efb89b updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:18.069201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d4998b74-c67b-4a9b-8a8d-658bc5efb89b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:18.417452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff69a4a3-7ec9-4e64-8ebb-4b2d8c5f53a0 service neutron] Resource Port 035fc085-892c-4866-9ff4-6bd3d7193e9b updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=035fc085-892c-4866-9ff4-6bd3d7193e9b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=035fc085-892c-4866-9ff4-6bd3d7193e9b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:18.417995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff69a4a3-7ec9-4e64-8ebb-4b2d8c5f53a0 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (035fc085-892c-4866-9ff4-6bd3d7193e9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:18.505340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['d4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2'] and devices down [] completed. Oct 09 00:56:18.505797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:251 - ports processed. Elapsed:1.919 Oct 09 00:56:18.506315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:251 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.919 Oct 09 00:56:18.588510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:252 started Oct 09 00:56:18.592685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=913000000,duration_sec=520,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:18.593502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:18.593926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:252 - starting polling. Elapsed:0.006 Oct 09 00:56:18.597178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:18.601342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:252 - port information retrieved. Elapsed:0.014 Oct 09 00:56:18.605254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e219175f-338c-47ca-ba2c-40a73c82d3b3', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', '4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'d4998b74-c67b-4a9b-8a8d-658bc5efb89b'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:56:18.606137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'device_id': 'edc3da25-e74d-4384-a954-79daecb75070', 'network_id': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'port_id': 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'mac_address': 'fa:16:3e:77:1a:42', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'e75c4721-9fa7-417f-9e12-2a9e53f66ae7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:18.616469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: d4998b74-c67b-4a9b-8a8d-658bc5efb89b {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:18.617017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port d4998b74-c67b-4a9b-8a8d-658bc5efb89b updated. Details: {'device': 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'device_id': 'edc3da25-e74d-4384-a954-79daecb75070', 'network_id': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'port_id': 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'mac_address': 'fa:16:3e:77:1a:42', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'e75c4721-9fa7-417f-9e12-2a9e53f66ae7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 09 00:56:18.618306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d4998b74-c6, col_values=(('tag', 7),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:18.618939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d4998b74-c6, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:18.619575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d4998b74-c6, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:18.620149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:18.620935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d4998b74-c6, col_values=(('other_config', {'net_uuid': 'dd937102-41e7-4629-a161-cb0fb39a0995', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '697', 'tag': '7'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:18.621680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:18.634439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee08,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:18.635109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:252 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.029 Oct 09 00:56:18.635788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:56:18.636269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:56:18.637616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:18.638073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:18.643759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:18.701843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda47102-2a6d-4d82-9e4a-20311116e382]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:18.702886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:252 - agent port security group processed in 0.097 Oct 09 00:56:18.704245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for d4998b74-c67b-4a9b-8a8d-658bc5efb89b to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:18.752177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-82eab92f-7cac-4281-93ac-e117a8771830 None None] Resource Port e465dbe5-5b91-47a1-b306-617be213fe16 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=e465dbe5-5b91-47a1-b306-617be213fe16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e465dbe5-5b91-47a1-b306-617be213fe16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:18.753056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-82eab92f-7cac-4281-93ac-e117a8771830 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e465dbe5-5b91-47a1-b306-617be213fe16), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:18.842932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f1270628-8c9d-4083-96c9-a61ea7bc7b1d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port ad40b227-899e-4d0c-a7ae-011b3f93ab4f updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '9667890c-b361-465c-9518-312df25d519f'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:18.844912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f1270628-8c9d-4083-96c9-a61ea7bc7b1d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ad40b227-899e-4d0c-a7ae-011b3f93ab4f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:19.040668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6c90b896-35a9-4424-b2c2-82fbb1b03b39 service neutron] Resource Port afb80013-2258-4db2-b056-f0c814dfdeed updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=afb80013-2258-4db2-b056-f0c814dfdeed,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=afb80013-2258-4db2-b056-f0c814dfdeed,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=afb80013-2258-4db2-b056-f0c814dfdeed,segment=NetworkSegment(21f1d887-4a9b-4110-9ac3-3d69ca77915d),segment_id=21f1d887-4a9b-4110-9ac3-3d69ca77915d)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:19.042487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6c90b896-35a9-4424-b2c2-82fbb1b03b39 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (afb80013-2258-4db2-b056-f0c814dfdeed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:19.072862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['d4998b74-c67b-4a9b-8a8d-658bc5efb89b'] and devices down [] completed. Oct 09 00:56:19.073489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:252 - ports processed. Elapsed:0.486 Oct 09 00:56:19.074064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:252 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.486 Oct 09 00:56:19.325982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff69a4a3-7ec9-4e64-8ebb-4b2d8c5f53a0 service neutron] Resource Port 035fc085-892c-4866-9ff4-6bd3d7193e9b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=035fc085-892c-4866-9ff4-6bd3d7193e9b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=035fc085-892c-4866-9ff4-6bd3d7193e9b,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=035fc085-892c-4866-9ff4-6bd3d7193e9b,segment=NetworkSegment(47eb43ca-62f0-426c-bb7d-8fbf6653ed4a),segment_id=47eb43ca-62f0-426c-bb7d-8fbf6653ed4a)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:19.326449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff69a4a3-7ec9-4e64-8ebb-4b2d8c5f53a0 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (035fc085-892c-4866-9ff4-6bd3d7193e9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:19.348451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-82eab92f-7cac-4281-93ac-e117a8771830 None None] Resource Port e465dbe5-5b91-47a1-b306-617be213fe16 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e465dbe5-5b91-47a1-b306-617be213fe16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e465dbe5-5b91-47a1-b306-617be213fe16,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e465dbe5-5b91-47a1-b306-617be213fe16,segment=NetworkSegment(e02957c6-4ac3-44cc-ac85-3fb22cee1088),segment_id=e02957c6-4ac3-44cc-ac85-3fb22cee1088)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:19.349183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-82eab92f-7cac-4281-93ac-e117a8771830 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e465dbe5-5b91-47a1-b306-617be213fe16), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:20.589442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:253 started Oct 09 00:56:20.594170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=913000000,duration_sec=522,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:20.609261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:20.609261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:253 - starting polling. Elapsed:0.006 Oct 09 00:56:20.609261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:20.609261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:253 - port information retrieved. Elapsed:0.015 Oct 09 00:56:20.609589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e219175f-338c-47ca-ba2c-40a73c82d3b3', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', '4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'e465dbe5-5b91-47a1-b306-617be213fe16'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:56:20.610162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'e465dbe5-5b91-47a1-b306-617be213fe16', 'device_id': 'c529cd40-e1fc-484f-b522-0bebbee463a2', 'network_id': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'port_id': 'e465dbe5-5b91-47a1-b306-617be213fe16', 'mac_address': 'fa:16:3e:d5:7e:14', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ff98a4f2-ed81-452c-99a3-cf1c43a2d01b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:20.614145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e465dbe5-5b91-47a1-b306-617be213fe16 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:20.614499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e465dbe5-5b91-47a1-b306-617be213fe16 updated. Details: {'device': 'e465dbe5-5b91-47a1-b306-617be213fe16', 'device_id': 'c529cd40-e1fc-484f-b522-0bebbee463a2', 'network_id': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'port_id': 'e465dbe5-5b91-47a1-b306-617be213fe16', 'mac_address': 'fa:16:3e:d5:7e:14', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ff98a4f2-ed81-452c-99a3-cf1c43a2d01b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 09 00:56:20.621317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e465dbe5-5b, col_values=(('tag', 6),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:20.621946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-e465dbe5-5b, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:20.622609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-e465dbe5-5b, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:20.643852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e465dbe5-5b, col_values=(('other_config', {'net_uuid': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '689'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:20.661372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee0c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:20.662119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:253 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.057 Oct 09 00:56:20.662745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:56:20.663350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:56:20.664839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:20.665424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:20.670017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:20.729500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[376bfd6f-5959-43f9-a6ac-d30579e74731]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:20.730128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:253 - agent port security group processed in 0.125 Oct 09 00:56:20.730886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for e465dbe5-5b91-47a1-b306-617be213fe16 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:21.009496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['e465dbe5-5b91-47a1-b306-617be213fe16'] and devices down [] completed. Oct 09 00:56:21.009870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:253 - ports processed. Elapsed:0.421 Oct 09 00:56:21.010361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:253 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.421 Oct 09 00:56:21.100896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port e465dbe5-5b91-47a1-b306-617be213fe16 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:21.101287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e465dbe5-5b91-47a1-b306-617be213fe16), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:22.592196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:254 started Oct 09 00:56:22.594634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=916000000,duration_sec=524,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:22.596475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:22.597001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:254 - starting polling. Elapsed:0.005 Oct 09 00:56:22.600100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:22.603904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:254 - port information retrieved. Elapsed:0.012 Oct 09 00:56:22.604407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e219175f-338c-47ca-ba2c-40a73c82d3b3', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', '4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'e465dbe5-5b91-47a1-b306-617be213fe16'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:56:22.605139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'e465dbe5-5b91-47a1-b306-617be213fe16', 'device_id': 'c529cd40-e1fc-484f-b522-0bebbee463a2', 'network_id': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'port_id': 'e465dbe5-5b91-47a1-b306-617be213fe16', 'mac_address': 'fa:16:3e:d5:7e:14', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ff98a4f2-ed81-452c-99a3-cf1c43a2d01b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:56:22.608434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e465dbe5-5b91-47a1-b306-617be213fe16 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:56:22.609078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e465dbe5-5b91-47a1-b306-617be213fe16 updated. Details: {'device': 'e465dbe5-5b91-47a1-b306-617be213fe16', 'device_id': 'c529cd40-e1fc-484f-b522-0bebbee463a2', 'network_id': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'port_id': 'e465dbe5-5b91-47a1-b306-617be213fe16', 'mac_address': 'fa:16:3e:d5:7e:14', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 689, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ff98a4f2-ed81-452c-99a3-cf1c43a2d01b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 09 00:56:22.610235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e465dbe5-5b, col_values=(('tag', 6),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:22.610774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-e465dbe5-5b, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:22.611520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-e465dbe5-5b, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:22.612298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:22.613147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e465dbe5-5b, col_values=(('other_config', {'net_uuid': 'ef6b019b-3ff0-42c3-b2bd-354f2c856ccc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '689', 'tag': '6'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:56:22.613903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:56:22.616451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee10,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:22.616984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:254 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.012 Oct 09 00:56:22.617479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:56:22.617909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:56:22.619319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:56:22.619799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:56:22.623850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:56:22.684943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[08913b55-9fac-45b4-8299-8554f354e71b]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:56:22.685866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:254 - agent port security group processed in 0.081 Oct 09 00:56:22.686635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for e465dbe5-5b91-47a1-b306-617be213fe16 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:56:22.861375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['e465dbe5-5b91-47a1-b306-617be213fe16'] and devices down [] completed. Oct 09 00:56:22.861771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:254 - ports processed. Elapsed:0.270 Oct 09 00:56:22.862179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:254 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.270 Oct 09 00:56:24.593021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:255 started Oct 09 00:56:24.596075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=916000000,duration_sec=526,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:24.596667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:24.597023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:255 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:56:26.594301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:256 started Oct 09 00:56:26.597556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=918000000,duration_sec=528,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:26.598167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:26.598613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:256 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:56:27.723914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1f0e86ff-fc28-4d16-b1d4-8e85c9fc35ed tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:27Z,data_plane_status=None,description='',device_id='a1b50472-3065-47ec-85b8-f52e36a9374c',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c41ba939-ec56-4a6f-86b0-047036daa405,mac_address=fa:16:3e:d7:f7:b3,name='',network_id=dd937102-41e7-4629-a161-cb0fb39a0995,numa_affinity_policy=,project_id='f68941040b3049bd9c62e2fc061d94c1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c41ba939-ec56-4a6f-86b0-047036daa405),security_group_ids=set([85d9ef2f-837e-44e1-bda5-e50dc5085b24]),status='DOWN',updated_at=2022-10-09T00:56:27Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:27.724464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1f0e86ff-fc28-4d16-b1d4-8e85c9fc35ed tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c41ba939-ec56-4a6f-86b0-047036daa405), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:27.724739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1f0e86ff-fc28-4d16-b1d4-8e85c9fc35ed tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group member updated {'85d9ef2f-837e-44e1-bda5-e50dc5085b24'} Oct 09 00:56:28.595785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:257 started Oct 09 00:56:28.598720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=920000000,duration_sec=530,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:28.599267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:28.599634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:257 - starting polling. Elapsed:0.004 Oct 09 00:56:28.601943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:28.604987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:257 - port information retrieved. Elapsed:0.009 Oct 09 00:56:28.605315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:257 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:56:30.596608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:258 started Oct 09 00:56:30.599045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=920000000,duration_sec=532,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:30.599615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:30.599971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:258 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:56:30.884521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e22422f4-f338-4f75-8f6f-ece2f5b18ccd service neutron] Resource Port c41ba939-ec56-4a6f-86b0-047036daa405 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=c41ba939-ec56-4a6f-86b0-047036daa405,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=c41ba939-ec56-4a6f-86b0-047036daa405,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:30.884897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e22422f4-f338-4f75-8f6f-ece2f5b18ccd service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c41ba939-ec56-4a6f-86b0-047036daa405), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:31.192709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e22422f4-f338-4f75-8f6f-ece2f5b18ccd service neutron] Resource Port c41ba939-ec56-4a6f-86b0-047036daa405 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c41ba939-ec56-4a6f-86b0-047036daa405,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c41ba939-ec56-4a6f-86b0-047036daa405,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c41ba939-ec56-4a6f-86b0-047036daa405,segment=NetworkSegment(8baf8725-752c-48bf-80b5-a9b2d3636b8e),segment_id=8baf8725-752c-48bf-80b5-a9b2d3636b8e)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:31.193953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e22422f4-f338-4f75-8f6f-ece2f5b18ccd service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c41ba939-ec56-4a6f-86b0-047036daa405), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:32.597809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:259 started Oct 09 00:56:32.600427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=921000000,duration_sec=534,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:32.600983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:32.601312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:259 - starting polling. Elapsed:0.004 Oct 09 00:56:32.603961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:32.606926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:259 - port information retrieved. Elapsed:0.009 Oct 09 00:56:32.607251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:259 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:56:34.608283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:260 started Oct 09 00:56:34.611221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=932000000,duration_sec=536,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:34.615077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:34.615664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:260 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 00:56:34.937664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c28f9874-0354-45ef-84f8-d6314f156530 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:33Z,data_plane_status=None,description='',device_id='b86736a3-d8f2-450d-a367-4d2ba4edd923',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8fe52a88-9c39-4ea8-9d6f-ca693b1da44c,mac_address=fa:16:3e:4f:06:11,name='',network_id=dd937102-41e7-4629-a161-cb0fb39a0995,numa_affinity_policy=,project_id='f68941040b3049bd9c62e2fc061d94c1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8fe52a88-9c39-4ea8-9d6f-ca693b1da44c),security_group_ids=set([85d9ef2f-837e-44e1-bda5-e50dc5085b24]),status='DOWN',updated_at=2022-10-09T00:56:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:34.952785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c28f9874-0354-45ef-84f8-d6314f156530 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8fe52a88-9c39-4ea8-9d6f-ca693b1da44c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:34.953390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c28f9874-0354-45ef-84f8-d6314f156530 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group member updated {'85d9ef2f-837e-44e1-bda5-e50dc5085b24'} Oct 09 00:56:35.827322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f4d6d6a-2269-4edb-974c-8dd7b2e2147e service neutron] Resource Port 8fe52a88-9c39-4ea8-9d6f-ca693b1da44c updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=8fe52a88-9c39-4ea8-9d6f-ca693b1da44c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=8fe52a88-9c39-4ea8-9d6f-ca693b1da44c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:35.828956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9f4d6d6a-2269-4edb-974c-8dd7b2e2147e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8fe52a88-9c39-4ea8-9d6f-ca693b1da44c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:35.970862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b70ae77-e749-4d8c-ac04-c3f2af155be7 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:56:35Z,data_plane_status=None,description='',device_id='acc5e0e3-a218-4f87-b4cc-2efeb32e281e',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=033058db-9b72-4aa7-b12d-bf2294dc0aa3,mac_address=fa:16:3e:2c:83:10,name='',network_id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,numa_affinity_policy=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(033058db-9b72-4aa7-b12d-bf2294dc0aa3),security_group_ids=set([777936c7-14aa-4727-901f-85cc3efdcde9]),status='DOWN',updated_at=2022-10-09T00:56:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:35.971945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b70ae77-e749-4d8c-ac04-c3f2af155be7 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (033058db-9b72-4aa7-b12d-bf2294dc0aa3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:35.972477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b70ae77-e749-4d8c-ac04-c3f2af155be7 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group member updated {'777936c7-14aa-4727-901f-85cc3efdcde9'} Oct 09 00:56:36.077860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f4d6d6a-2269-4edb-974c-8dd7b2e2147e service neutron] Resource Port 8fe52a88-9c39-4ea8-9d6f-ca693b1da44c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8fe52a88-9c39-4ea8-9d6f-ca693b1da44c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8fe52a88-9c39-4ea8-9d6f-ca693b1da44c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=8fe52a88-9c39-4ea8-9d6f-ca693b1da44c,segment=NetworkSegment(8baf8725-752c-48bf-80b5-a9b2d3636b8e),segment_id=8baf8725-752c-48bf-80b5-a9b2d3636b8e)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:36.078196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9f4d6d6a-2269-4edb-974c-8dd7b2e2147e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8fe52a88-9c39-4ea8-9d6f-ca693b1da44c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:36.609050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:261 started Oct 09 00:56:36.611321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=932000000,duration_sec=538,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:36.611908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:36.612235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:261 - starting polling. Elapsed:0.003 Oct 09 00:56:36.614561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:36.617607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:261 - port information retrieved. Elapsed:0.009 Oct 09 00:56:36.617935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:261 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 00:56:38.616367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:262 started Oct 09 00:56:38.619300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=938000000,duration_sec=540,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:38.619300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:38.619300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:262 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 00:56:38.649903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-10274254-799e-4e2a-a63b-6aa59f937f8d service neutron] Resource Port 033058db-9b72-4aa7-b12d-bf2294dc0aa3 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=033058db-9b72-4aa7-b12d-bf2294dc0aa3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=033058db-9b72-4aa7-b12d-bf2294dc0aa3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:38.650605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-10274254-799e-4e2a-a63b-6aa59f937f8d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (033058db-9b72-4aa7-b12d-bf2294dc0aa3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:38.983988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-10274254-799e-4e2a-a63b-6aa59f937f8d service neutron] Resource Port 033058db-9b72-4aa7-b12d-bf2294dc0aa3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=033058db-9b72-4aa7-b12d-bf2294dc0aa3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=033058db-9b72-4aa7-b12d-bf2294dc0aa3,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=033058db-9b72-4aa7-b12d-bf2294dc0aa3,segment=NetworkSegment(e02957c6-4ac3-44cc-ac85-3fb22cee1088),segment_id=e02957c6-4ac3-44cc-ac85-3fb22cee1088)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:38.984369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-10274254-799e-4e2a-a63b-6aa59f937f8d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (033058db-9b72-4aa7-b12d-bf2294dc0aa3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:40.625114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:263 started Oct 09 00:56:40.631846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=949000000,duration_sec=542,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:40.632862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:40.633338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:263 - starting polling. Elapsed:0.008 Oct 09 00:56:40.636635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:40.641518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:263 - port information retrieved. Elapsed:0.016 Oct 09 00:56:40.641997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:263 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 09 00:56:41.703831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:41Z,description='Default security group',id=29913cb4-acdd-4417-ac1a-666b7b2482b4,is_default=True,name='default',project_id='900310e660e24f5f9957164068179944',revision_number=1,rules=[SecurityGroupRule(177f290d-eaa6-4066-ae9a-ba8821b84a93),SecurityGroupRule(6ee20fdb-86b3-4ea0-b7aa-fdebe20b513e),SecurityGroupRule(dce2ca03-4a71-483e-afb5-9d5ab04038a1),SecurityGroupRule(ee72eccd-e07c-407b-9046-1fb6df85565c)],shared=False,stateful=True,updated_at=2022-10-09T00:56:41Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:41.704507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (29913cb4-acdd-4417-ac1a-666b7b2482b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.705139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:41Z,description=,direction='egress',ethertype='IPv6',id=177f290d-eaa6-4066-ae9a-ba8821b84a93,normalized_cidr=None,port_range_max=,port_range_min=,project_id='900310e660e24f5f9957164068179944',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=29913cb4-acdd-4417-ac1a-666b7b2482b4,updated_at=2022-10-09T00:56:41Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:41.705600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (177f290d-eaa6-4066-ae9a-ba8821b84a93), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.706721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Security group rule updated ['29913cb4-acdd-4417-ac1a-666b7b2482b4'] Oct 09 00:56:41.707695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:41Z,description=,direction='ingress',ethertype='IPv4',id=6ee20fdb-86b3-4ea0-b7aa-fdebe20b513e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='900310e660e24f5f9957164068179944',protocol=,remote_address_group_id=,remote_group_id=29913cb4-acdd-4417-ac1a-666b7b2482b4,remote_ip_prefix=,revision_number=0,security_group_id=29913cb4-acdd-4417-ac1a-666b7b2482b4,updated_at=2022-10-09T00:56:41Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:41.708153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6ee20fdb-86b3-4ea0-b7aa-fdebe20b513e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.708575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Security group rule updated ['29913cb4-acdd-4417-ac1a-666b7b2482b4'] Oct 09 00:56:41.713882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:41Z,description=,direction='ingress',ethertype='IPv6',id=dce2ca03-4a71-483e-afb5-9d5ab04038a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='900310e660e24f5f9957164068179944',protocol=,remote_address_group_id=,remote_group_id=29913cb4-acdd-4417-ac1a-666b7b2482b4,remote_ip_prefix=,revision_number=0,security_group_id=29913cb4-acdd-4417-ac1a-666b7b2482b4,updated_at=2022-10-09T00:56:41Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:41.714613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (dce2ca03-4a71-483e-afb5-9d5ab04038a1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.715171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Security group rule updated ['29913cb4-acdd-4417-ac1a-666b7b2482b4'] Oct 09 00:56:41.717028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:41Z,description=,direction='egress',ethertype='IPv4',id=ee72eccd-e07c-407b-9046-1fb6df85565c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='900310e660e24f5f9957164068179944',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=29913cb4-acdd-4417-ac1a-666b7b2482b4,updated_at=2022-10-09T00:56:41Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:41.718070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ee72eccd-e07c-407b-9046-1fb6df85565c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.718911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff84bb1c-8e4b-4fc7-bf2c-f13500121e1d admin admin] Security group rule updated ['29913cb4-acdd-4417-ac1a-666b7b2482b4'] Oct 09 00:56:41.929688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Resource SecurityGroup deleted: 29913cb4-acdd-4417-ac1a-666b7b2482b4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:41.930068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (29913cb4-acdd-4417-ac1a-666b7b2482b4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.931449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('29913cb4-acdd-4417-ac1a-666b7b2482b4',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:41.945278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('29913cb4-acdd-4417-ac1a-666b7b2482b4',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:41.945665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Resource SecurityGroupRule deleted: 177f290d-eaa6-4066-ae9a-ba8821b84a93 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:41.946038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (177f290d-eaa6-4066-ae9a-ba8821b84a93), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.946376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Security group rule updated ['29913cb4-acdd-4417-ac1a-666b7b2482b4'] Oct 09 00:56:41.946766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Resource SecurityGroupRule deleted: 6ee20fdb-86b3-4ea0-b7aa-fdebe20b513e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:41.947108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6ee20fdb-86b3-4ea0-b7aa-fdebe20b513e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.947429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Security group rule updated ['29913cb4-acdd-4417-ac1a-666b7b2482b4'] Oct 09 00:56:41.947841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Resource SecurityGroupRule deleted: dce2ca03-4a71-483e-afb5-9d5ab04038a1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:41.948337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (dce2ca03-4a71-483e-afb5-9d5ab04038a1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.948975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Security group rule updated ['29913cb4-acdd-4417-ac1a-666b7b2482b4'] Oct 09 00:56:41.949484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Resource SecurityGroupRule deleted: ee72eccd-e07c-407b-9046-1fb6df85565c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:41.949970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ee72eccd-e07c-407b-9046-1fb6df85565c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:41.950441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb54a331-8e9d-4cf7-aef4-94e05998da66 admin admin] Security group rule updated ['29913cb4-acdd-4417-ac1a-666b7b2482b4'] Oct 09 00:56:42.388306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:42Z,description='Default security group',id=fff43e62-f865-4bfe-8641-4d37b0a5b7b4,is_default=True,name='default',project_id='7415bcf3ee6f426ba3f908b200ad3bb3',revision_number=1,rules=[SecurityGroupRule(1bc4f5df-53ac-4e92-b743-8c080289541b),SecurityGroupRule(2cd1c2ec-a144-4642-8b7f-a508a19655ed),SecurityGroupRule(626549ff-f1f3-406e-b889-dfaf46f98fcd),SecurityGroupRule(d6545daf-1540-40a7-a5c9-0f117c79ecd1)],shared=False,stateful=True,updated_at=2022-10-09T00:56:42Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:42.388694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (fff43e62-f865-4bfe-8641-4d37b0a5b7b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.389313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:42Z,description=,direction='egress',ethertype='IPv6',id=1bc4f5df-53ac-4e92-b743-8c080289541b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7415bcf3ee6f426ba3f908b200ad3bb3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fff43e62-f865-4bfe-8641-4d37b0a5b7b4,updated_at=2022-10-09T00:56:42Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:42.389672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1bc4f5df-53ac-4e92-b743-8c080289541b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.390004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Security group rule updated ['fff43e62-f865-4bfe-8641-4d37b0a5b7b4'] Oct 09 00:56:42.390671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:42Z,description=,direction='ingress',ethertype='IPv4',id=2cd1c2ec-a144-4642-8b7f-a508a19655ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7415bcf3ee6f426ba3f908b200ad3bb3',protocol=,remote_address_group_id=,remote_group_id=fff43e62-f865-4bfe-8641-4d37b0a5b7b4,remote_ip_prefix=,revision_number=0,security_group_id=fff43e62-f865-4bfe-8641-4d37b0a5b7b4,updated_at=2022-10-09T00:56:42Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:42.391020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2cd1c2ec-a144-4642-8b7f-a508a19655ed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.391343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Security group rule updated ['fff43e62-f865-4bfe-8641-4d37b0a5b7b4'] Oct 09 00:56:42.392185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:42Z,description=,direction='ingress',ethertype='IPv6',id=626549ff-f1f3-406e-b889-dfaf46f98fcd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7415bcf3ee6f426ba3f908b200ad3bb3',protocol=,remote_address_group_id=,remote_group_id=fff43e62-f865-4bfe-8641-4d37b0a5b7b4,remote_ip_prefix=,revision_number=0,security_group_id=fff43e62-f865-4bfe-8641-4d37b0a5b7b4,updated_at=2022-10-09T00:56:42Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:42.392559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (626549ff-f1f3-406e-b889-dfaf46f98fcd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.392885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Security group rule updated ['fff43e62-f865-4bfe-8641-4d37b0a5b7b4'] Oct 09 00:56:42.393527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:42Z,description=,direction='egress',ethertype='IPv4',id=d6545daf-1540-40a7-a5c9-0f117c79ecd1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7415bcf3ee6f426ba3f908b200ad3bb3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fff43e62-f865-4bfe-8641-4d37b0a5b7b4,updated_at=2022-10-09T00:56:42Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:42.393943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d6545daf-1540-40a7-a5c9-0f117c79ecd1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.394278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-30886371-d006-4425-a69d-4a95b960fee8 admin admin] Security group rule updated ['fff43e62-f865-4bfe-8641-4d37b0a5b7b4'] Oct 09 00:56:42.519043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Resource SecurityGroup deleted: fff43e62-f865-4bfe-8641-4d37b0a5b7b4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:42.519401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (fff43e62-f865-4bfe-8641-4d37b0a5b7b4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.519873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fff43e62-f865-4bfe-8641-4d37b0a5b7b4',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:42.533637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fff43e62-f865-4bfe-8641-4d37b0a5b7b4',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:42.534681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Resource SecurityGroupRule deleted: 1bc4f5df-53ac-4e92-b743-8c080289541b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:42.535047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1bc4f5df-53ac-4e92-b743-8c080289541b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.535371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Security group rule updated ['fff43e62-f865-4bfe-8641-4d37b0a5b7b4'] Oct 09 00:56:42.535781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Resource SecurityGroupRule deleted: 2cd1c2ec-a144-4642-8b7f-a508a19655ed {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:42.536128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2cd1c2ec-a144-4642-8b7f-a508a19655ed), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.536440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Security group rule updated ['fff43e62-f865-4bfe-8641-4d37b0a5b7b4'] Oct 09 00:56:42.536798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Resource SecurityGroupRule deleted: 626549ff-f1f3-406e-b889-dfaf46f98fcd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:42.537132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (626549ff-f1f3-406e-b889-dfaf46f98fcd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.537441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Security group rule updated ['fff43e62-f865-4bfe-8641-4d37b0a5b7b4'] Oct 09 00:56:42.537799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Resource SecurityGroupRule deleted: d6545daf-1540-40a7-a5c9-0f117c79ecd1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:42.538129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d6545daf-1540-40a7-a5c9-0f117c79ecd1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:42.538433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-19a57dfe-c686-4353-b0a3-5751ca270196 admin admin] Security group rule updated ['fff43e62-f865-4bfe-8641-4d37b0a5b7b4'] Oct 09 00:56:42.626674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:264 started Oct 09 00:56:42.629894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=951000000,duration_sec=544,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:42.630467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:42.630819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:264 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:56:44.223117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port afb80013-2258-4db2-b056-f0c814dfdeed updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:44.224665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (afb80013-2258-4db2-b056-f0c814dfdeed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:44.520590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 035fc085-892c-4866-9ff4-6bd3d7193e9b updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:44.521223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (035fc085-892c-4866-9ff4-6bd3d7193e9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:44.628439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:265 started Oct 09 00:56:44.631662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=952000000,duration_sec=546,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:44.632640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:44.634038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:265 - starting polling. Elapsed:0.006 Oct 09 00:56:44.637185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:44.642434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:265 - port information retrieved. Elapsed:0.015 Oct 09 00:56:44.644374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:265 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 09 00:56:44.889315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port c41ba939-ec56-4a6f-86b0-047036daa405 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:44.889914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c41ba939-ec56-4a6f-86b0-047036daa405), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:46.629776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:266 started Oct 09 00:56:46.632149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=953000000,duration_sec=548,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:46.632701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:46.633023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:266 - starting polling. Elapsed:0.003 Oct 09 00:56:46.635300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:46.638266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:266 - port information retrieved. Elapsed:0.009 Oct 09 00:56:46.638589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:266 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 00:56:48.630861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:267 started Oct 09 00:56:48.634265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=955000000,duration_sec=550,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:48.634899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:48.635255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:267 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:56:50.632117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:268 started Oct 09 00:56:50.634381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=955000000,duration_sec=552,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:50.634949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:50.635321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:268 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:56:52.632637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:269 started Oct 09 00:56:52.635469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=956000000,duration_sec=554,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:52.636541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:52.637105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:269 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:56:52.853821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port afb80013-2258-4db2-b056-f0c814dfdeed updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:52.854487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (afb80013-2258-4db2-b056-f0c814dfdeed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:53.184863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 035fc085-892c-4866-9ff4-6bd3d7193e9b updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:53.185289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (035fc085-892c-4866-9ff4-6bd3d7193e9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:53.526702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port c41ba939-ec56-4a6f-86b0-047036daa405 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:53.527855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c41ba939-ec56-4a6f-86b0-047036daa405), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:53.878283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:53Z,description='Default security group',id=a72493a9-1a18-44ef-9727-389167d4cb82,is_default=True,name='default',project_id='013c83476b1340fbb051061833c4a9c6',revision_number=1,rules=[SecurityGroupRule(2fc5dc9b-f87d-4942-8c8f-7a84047ed115),SecurityGroupRule(a1b41026-81f1-435c-ac3c-b62994459cae),SecurityGroupRule(e504f58f-57b8-469d-a5ec-a3c89b9a1d0e),SecurityGroupRule(eeaf2a28-a6df-4b32-84ce-08c890d3abe4)],shared=False,stateful=True,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:53.878941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (a72493a9-1a18-44ef-9727-389167d4cb82), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:53.879670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='egress',ethertype='IPv4',id=2fc5dc9b-f87d-4942-8c8f-7a84047ed115,normalized_cidr=None,port_range_max=,port_range_min=,project_id='013c83476b1340fbb051061833c4a9c6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a72493a9-1a18-44ef-9727-389167d4cb82,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:53.879670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2fc5dc9b-f87d-4942-8c8f-7a84047ed115), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:53.879982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Security group rule updated ['a72493a9-1a18-44ef-9727-389167d4cb82'] Oct 09 00:56:53.881024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='egress',ethertype='IPv6',id=a1b41026-81f1-435c-ac3c-b62994459cae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='013c83476b1340fbb051061833c4a9c6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a72493a9-1a18-44ef-9727-389167d4cb82,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:53.881142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a1b41026-81f1-435c-ac3c-b62994459cae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:53.881478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Security group rule updated ['a72493a9-1a18-44ef-9727-389167d4cb82'] Oct 09 00:56:53.883003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='ingress',ethertype='IPv6',id=e504f58f-57b8-469d-a5ec-a3c89b9a1d0e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='013c83476b1340fbb051061833c4a9c6',protocol=,remote_address_group_id=,remote_group_id=a72493a9-1a18-44ef-9727-389167d4cb82,remote_ip_prefix=,revision_number=0,security_group_id=a72493a9-1a18-44ef-9727-389167d4cb82,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:53.883426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e504f58f-57b8-469d-a5ec-a3c89b9a1d0e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:53.883776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Security group rule updated ['a72493a9-1a18-44ef-9727-389167d4cb82'] Oct 09 00:56:53.884445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='ingress',ethertype='IPv4',id=eeaf2a28-a6df-4b32-84ce-08c890d3abe4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='013c83476b1340fbb051061833c4a9c6',protocol=,remote_address_group_id=,remote_group_id=a72493a9-1a18-44ef-9727-389167d4cb82,remote_ip_prefix=,revision_number=0,security_group_id=a72493a9-1a18-44ef-9727-389167d4cb82,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:53.884868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (eeaf2a28-a6df-4b32-84ce-08c890d3abe4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:53.885111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fbe62803-c914-4ba7-8da8-9907cf725ae2 service neutron] Security group rule updated ['a72493a9-1a18-44ef-9727-389167d4cb82'] Oct 09 00:56:54.059041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:53Z,description='Default security group',id=0f52d6d4-f2dc-466d-abdb-dce59619ba10,is_default=True,name='default',project_id='f8a9c991802a4922af406d3734336bb5',revision_number=1,rules=[SecurityGroupRule(0fe87533-cff1-4e73-b44e-bcee5d08264b),SecurityGroupRule(4dcedfae-b11b-48c1-9a80-86a8c236af7d),SecurityGroupRule(a484a9d8-6269-49ee-b875-dc5935f94d8a),SecurityGroupRule(d1901630-4435-4f87-b9d7-f3e3cec2ebc8)],shared=False,stateful=True,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.060017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (0f52d6d4-f2dc-466d-abdb-dce59619ba10), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.060937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='ingress',ethertype='IPv6',id=0fe87533-cff1-4e73-b44e-bcee5d08264b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f8a9c991802a4922af406d3734336bb5',protocol=,remote_address_group_id=,remote_group_id=0f52d6d4-f2dc-466d-abdb-dce59619ba10,remote_ip_prefix=,revision_number=0,security_group_id=0f52d6d4-f2dc-466d-abdb-dce59619ba10,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.061509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0fe87533-cff1-4e73-b44e-bcee5d08264b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.062046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Security group rule updated ['0f52d6d4-f2dc-466d-abdb-dce59619ba10'] Oct 09 00:56:54.063117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='egress',ethertype='IPv4',id=4dcedfae-b11b-48c1-9a80-86a8c236af7d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f8a9c991802a4922af406d3734336bb5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0f52d6d4-f2dc-466d-abdb-dce59619ba10,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.063702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4dcedfae-b11b-48c1-9a80-86a8c236af7d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.064539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Security group rule updated ['0f52d6d4-f2dc-466d-abdb-dce59619ba10'] Oct 09 00:56:54.066112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='egress',ethertype='IPv6',id=a484a9d8-6269-49ee-b875-dc5935f94d8a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f8a9c991802a4922af406d3734336bb5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0f52d6d4-f2dc-466d-abdb-dce59619ba10,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.066680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a484a9d8-6269-49ee-b875-dc5935f94d8a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.070536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Security group rule updated ['0f52d6d4-f2dc-466d-abdb-dce59619ba10'] Oct 09 00:56:54.071483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='ingress',ethertype='IPv4',id=d1901630-4435-4f87-b9d7-f3e3cec2ebc8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f8a9c991802a4922af406d3734336bb5',protocol=,remote_address_group_id=,remote_group_id=0f52d6d4-f2dc-466d-abdb-dce59619ba10,remote_ip_prefix=,revision_number=0,security_group_id=0f52d6d4-f2dc-466d-abdb-dce59619ba10,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.078002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d1901630-4435-4f87-b9d7-f3e3cec2ebc8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.091752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ad4cedb5-6b54-4008-8e81-d26286237aa8 admin admin] Security group rule updated ['0f52d6d4-f2dc-466d-abdb-dce59619ba10'] Oct 09 00:56:54.159710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:53Z,description='Default security group',id=e142db36-0a9f-4655-9201-6ebf27cd1b9c,is_default=True,name='default',project_id='2912461a18214cb5a7b0762205e64b1e',revision_number=1,rules=[SecurityGroupRule(20a18371-4bc5-4f3e-b829-3d132e14545a),SecurityGroupRule(5f0f4f5d-cdf8-4237-bc6b-6f8b6f6d9ec0),SecurityGroupRule(bffe1478-5be0-487e-9ede-92349de1eee5),SecurityGroupRule(f1ff34dd-235e-4342-9cca-712b4fa6c89d)],shared=False,stateful=True,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.160406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (e142db36-0a9f-4655-9201-6ebf27cd1b9c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.161164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='ingress',ethertype='IPv6',id=20a18371-4bc5-4f3e-b829-3d132e14545a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2912461a18214cb5a7b0762205e64b1e',protocol=,remote_address_group_id=,remote_group_id=e142db36-0a9f-4655-9201-6ebf27cd1b9c,remote_ip_prefix=,revision_number=0,security_group_id=e142db36-0a9f-4655-9201-6ebf27cd1b9c,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.161594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (20a18371-4bc5-4f3e-b829-3d132e14545a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.161997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Security group rule updated ['e142db36-0a9f-4655-9201-6ebf27cd1b9c'] Oct 09 00:56:54.163025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='egress',ethertype='IPv6',id=5f0f4f5d-cdf8-4237-bc6b-6f8b6f6d9ec0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2912461a18214cb5a7b0762205e64b1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e142db36-0a9f-4655-9201-6ebf27cd1b9c,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.165658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5f0f4f5d-cdf8-4237-bc6b-6f8b6f6d9ec0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.166073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Security group rule updated ['e142db36-0a9f-4655-9201-6ebf27cd1b9c'] Oct 09 00:56:54.166876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='ingress',ethertype='IPv4',id=bffe1478-5be0-487e-9ede-92349de1eee5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2912461a18214cb5a7b0762205e64b1e',protocol=,remote_address_group_id=,remote_group_id=e142db36-0a9f-4655-9201-6ebf27cd1b9c,remote_ip_prefix=,revision_number=0,security_group_id=e142db36-0a9f-4655-9201-6ebf27cd1b9c,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.167970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (bffe1478-5be0-487e-9ede-92349de1eee5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.168375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Security group rule updated ['e142db36-0a9f-4655-9201-6ebf27cd1b9c'] Oct 09 00:56:54.172205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:53Z,description=,direction='egress',ethertype='IPv4',id=f1ff34dd-235e-4342-9cca-712b4fa6c89d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2912461a18214cb5a7b0762205e64b1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e142db36-0a9f-4655-9201-6ebf27cd1b9c,updated_at=2022-10-09T00:56:53Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:54.172672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f1ff34dd-235e-4342-9cca-712b4fa6c89d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.173118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7ebaddb5-5350-4fc2-8484-d134cc85d786 admin admin] Security group rule updated ['e142db36-0a9f-4655-9201-6ebf27cd1b9c'] Oct 09 00:56:54.349242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 8fe52a88-9c39-4ea8-9d6f-ca693b1da44c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:54.349895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8fe52a88-9c39-4ea8-9d6f-ca693b1da44c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.359430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Resource SecurityGroup deleted: 0f52d6d4-f2dc-466d-abdb-dce59619ba10 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.359430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (0f52d6d4-f2dc-466d-abdb-dce59619ba10), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.359430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0f52d6d4-f2dc-466d-abdb-dce59619ba10',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:54.384410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0f52d6d4-f2dc-466d-abdb-dce59619ba10',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:54.385154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Resource SecurityGroupRule deleted: 0fe87533-cff1-4e73-b44e-bcee5d08264b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.386266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0fe87533-cff1-4e73-b44e-bcee5d08264b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.387318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Security group rule updated ['0f52d6d4-f2dc-466d-abdb-dce59619ba10'] Oct 09 00:56:54.388664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Resource SecurityGroupRule deleted: 4dcedfae-b11b-48c1-9a80-86a8c236af7d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.390115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4dcedfae-b11b-48c1-9a80-86a8c236af7d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.391087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Security group rule updated ['0f52d6d4-f2dc-466d-abdb-dce59619ba10'] Oct 09 00:56:54.392487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Resource SecurityGroupRule deleted: a484a9d8-6269-49ee-b875-dc5935f94d8a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.392848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a484a9d8-6269-49ee-b875-dc5935f94d8a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.393207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Security group rule updated ['0f52d6d4-f2dc-466d-abdb-dce59619ba10'] Oct 09 00:56:54.393579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Resource SecurityGroupRule deleted: d1901630-4435-4f87-b9d7-f3e3cec2ebc8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.393923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d1901630-4435-4f87-b9d7-f3e3cec2ebc8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.394383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-be98cfaf-eecd-4ef4-8ea9-f1c776c8b4a1 admin admin] Security group rule updated ['0f52d6d4-f2dc-466d-abdb-dce59619ba10'] Oct 09 00:56:54.492455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Resource SecurityGroup deleted: e142db36-0a9f-4655-9201-6ebf27cd1b9c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.492900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (e142db36-0a9f-4655-9201-6ebf27cd1b9c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.493367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e142db36-0a9f-4655-9201-6ebf27cd1b9c',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:54.526860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e142db36-0a9f-4655-9201-6ebf27cd1b9c',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:54.536290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Resource SecurityGroupRule deleted: 20a18371-4bc5-4f3e-b829-3d132e14545a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.538910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (20a18371-4bc5-4f3e-b829-3d132e14545a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.539896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Security group rule updated ['e142db36-0a9f-4655-9201-6ebf27cd1b9c'] Oct 09 00:56:54.540502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Resource SecurityGroupRule deleted: 5f0f4f5d-cdf8-4237-bc6b-6f8b6f6d9ec0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.541583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5f0f4f5d-cdf8-4237-bc6b-6f8b6f6d9ec0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.542660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Security group rule updated ['e142db36-0a9f-4655-9201-6ebf27cd1b9c'] Oct 09 00:56:54.543098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Resource SecurityGroupRule deleted: bffe1478-5be0-487e-9ede-92349de1eee5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.544634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (bffe1478-5be0-487e-9ede-92349de1eee5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.544634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Security group rule updated ['e142db36-0a9f-4655-9201-6ebf27cd1b9c'] Oct 09 00:56:54.544634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Resource SecurityGroupRule deleted: f1ff34dd-235e-4342-9cca-712b4fa6c89d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:54.544634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f1ff34dd-235e-4342-9cca-712b4fa6c89d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.545018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51a09629-4873-4dc1-8926-3fa2cf72c37f admin admin] Security group rule updated ['e142db36-0a9f-4655-9201-6ebf27cd1b9c'] Oct 09 00:56:54.590180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 033058db-9b72-4aa7-b12d-bf2294dc0aa3 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:54.590573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (033058db-9b72-4aa7-b12d-bf2294dc0aa3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.633749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:270 started Oct 09 00:56:54.638567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=958000000,duration_sec=556,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:54.639686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:54.639925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:270 - starting polling. Elapsed:0.007 Oct 09 00:56:54.644454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:54.651624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:270 - port information retrieved. Elapsed:0.018 Oct 09 00:56:54.652321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:270 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Oct 09 00:56:55.074904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:54Z,description='Default security group',id=8d4d7d19-af41-48f1-983d-fa2d97aac40f,is_default=True,name='default',project_id='0df83ee2d3544020aff2bb52b6aef9cb',revision_number=1,rules=[SecurityGroupRule(25778e60-1bfe-4824-bcd3-f3a1e7550096),SecurityGroupRule(85f02304-7ef8-40e7-81c3-2656a5f103d7),SecurityGroupRule(8d69d24e-d8f1-4b3d-98c0-d61d20b756a7),SecurityGroupRule(c274bb6f-0ac7-40cf-b19a-790e95ccfffa)],shared=False,stateful=True,updated_at=2022-10-09T00:56:54Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.076493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (8d4d7d19-af41-48f1-983d-fa2d97aac40f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.083381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:54Z,description=,direction='egress',ethertype='IPv4',id=25778e60-1bfe-4824-bcd3-f3a1e7550096,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0df83ee2d3544020aff2bb52b6aef9cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d4d7d19-af41-48f1-983d-fa2d97aac40f,updated_at=2022-10-09T00:56:54Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.084074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (25778e60-1bfe-4824-bcd3-f3a1e7550096), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.084536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Security group rule updated ['8d4d7d19-af41-48f1-983d-fa2d97aac40f'] Oct 09 00:56:55.088124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:54Z,description=,direction='egress',ethertype='IPv6',id=85f02304-7ef8-40e7-81c3-2656a5f103d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0df83ee2d3544020aff2bb52b6aef9cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d4d7d19-af41-48f1-983d-fa2d97aac40f,updated_at=2022-10-09T00:56:54Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.089713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (85f02304-7ef8-40e7-81c3-2656a5f103d7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.089713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Security group rule updated ['8d4d7d19-af41-48f1-983d-fa2d97aac40f'] Oct 09 00:56:55.094713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:54Z,description=,direction='ingress',ethertype='IPv4',id=8d69d24e-d8f1-4b3d-98c0-d61d20b756a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0df83ee2d3544020aff2bb52b6aef9cb',protocol=,remote_address_group_id=,remote_group_id=8d4d7d19-af41-48f1-983d-fa2d97aac40f,remote_ip_prefix=,revision_number=0,security_group_id=8d4d7d19-af41-48f1-983d-fa2d97aac40f,updated_at=2022-10-09T00:56:54Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.096670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8d69d24e-d8f1-4b3d-98c0-d61d20b756a7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.097123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Security group rule updated ['8d4d7d19-af41-48f1-983d-fa2d97aac40f'] Oct 09 00:56:55.098124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:54Z,description=,direction='ingress',ethertype='IPv6',id=c274bb6f-0ac7-40cf-b19a-790e95ccfffa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0df83ee2d3544020aff2bb52b6aef9cb',protocol=,remote_address_group_id=,remote_group_id=8d4d7d19-af41-48f1-983d-fa2d97aac40f,remote_ip_prefix=,revision_number=0,security_group_id=8d4d7d19-af41-48f1-983d-fa2d97aac40f,updated_at=2022-10-09T00:56:54Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.101046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c274bb6f-0ac7-40cf-b19a-790e95ccfffa), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.101629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cfbbebb0-8916-4a44-a42b-5eb93aa48d56 admin admin] Security group rule updated ['8d4d7d19-af41-48f1-983d-fa2d97aac40f'] Oct 09 00:56:55.297648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:55Z,description='Default security group',id=4aaae477-9673-4764-96de-2ca0051da504,is_default=True,name='default',project_id='abf32db91d464fe4b470eebe5bf0c78d',revision_number=1,rules=[SecurityGroupRule(1f83fa6f-2f49-4691-99d8-36ff7187b669),SecurityGroupRule(81711303-a80f-487a-aa95-dbd64636be05),SecurityGroupRule(82a863f2-6308-4d0e-b85c-571d842cde70),SecurityGroupRule(a3fd2570-e3b5-4171-8408-5285829f75b8)],shared=False,stateful=True,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.298024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (4aaae477-9673-4764-96de-2ca0051da504), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.298924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:55Z,description=,direction='egress',ethertype='IPv6',id=1f83fa6f-2f49-4691-99d8-36ff7187b669,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abf32db91d464fe4b470eebe5bf0c78d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4aaae477-9673-4764-96de-2ca0051da504,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.300548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1f83fa6f-2f49-4691-99d8-36ff7187b669), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.303383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Security group rule updated ['4aaae477-9673-4764-96de-2ca0051da504'] Oct 09 00:56:55.304437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:55Z,description=,direction='egress',ethertype='IPv4',id=81711303-a80f-487a-aa95-dbd64636be05,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abf32db91d464fe4b470eebe5bf0c78d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4aaae477-9673-4764-96de-2ca0051da504,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.307742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (81711303-a80f-487a-aa95-dbd64636be05), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.308321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Security group rule updated ['4aaae477-9673-4764-96de-2ca0051da504'] Oct 09 00:56:55.309784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:55Z,description=,direction='ingress',ethertype='IPv6',id=82a863f2-6308-4d0e-b85c-571d842cde70,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abf32db91d464fe4b470eebe5bf0c78d',protocol=,remote_address_group_id=,remote_group_id=4aaae477-9673-4764-96de-2ca0051da504,remote_ip_prefix=,revision_number=0,security_group_id=4aaae477-9673-4764-96de-2ca0051da504,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.310707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (82a863f2-6308-4d0e-b85c-571d842cde70), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.311946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Security group rule updated ['4aaae477-9673-4764-96de-2ca0051da504'] Oct 09 00:56:55.316671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:55Z,description=,direction='ingress',ethertype='IPv4',id=a3fd2570-e3b5-4171-8408-5285829f75b8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abf32db91d464fe4b470eebe5bf0c78d',protocol=,remote_address_group_id=,remote_group_id=4aaae477-9673-4764-96de-2ca0051da504,remote_ip_prefix=,revision_number=0,security_group_id=4aaae477-9673-4764-96de-2ca0051da504,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:55.317118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a3fd2570-e3b5-4171-8408-5285829f75b8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.317555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f609060-3322-4374-ad8c-a75328841625 admin admin] Security group rule updated ['4aaae477-9673-4764-96de-2ca0051da504'] Oct 09 00:56:55.342969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Resource SecurityGroup deleted: 8d4d7d19-af41-48f1-983d-fa2d97aac40f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.343426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (8d4d7d19-af41-48f1-983d-fa2d97aac40f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.344145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8d4d7d19-af41-48f1-983d-fa2d97aac40f',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:55.409427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8d4d7d19-af41-48f1-983d-fa2d97aac40f',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:55.410072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Resource SecurityGroupRule deleted: 25778e60-1bfe-4824-bcd3-f3a1e7550096 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.410884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (25778e60-1bfe-4824-bcd3-f3a1e7550096), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.411331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Security group rule updated ['8d4d7d19-af41-48f1-983d-fa2d97aac40f'] Oct 09 00:56:55.411868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Resource SecurityGroupRule deleted: 85f02304-7ef8-40e7-81c3-2656a5f103d7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.412308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (85f02304-7ef8-40e7-81c3-2656a5f103d7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.412992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Security group rule updated ['8d4d7d19-af41-48f1-983d-fa2d97aac40f'] Oct 09 00:56:55.414989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Resource SecurityGroupRule deleted: 8d69d24e-d8f1-4b3d-98c0-d61d20b756a7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.415580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8d69d24e-d8f1-4b3d-98c0-d61d20b756a7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.416236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Security group rule updated ['8d4d7d19-af41-48f1-983d-fa2d97aac40f'] Oct 09 00:56:55.416834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Resource SecurityGroupRule deleted: c274bb6f-0ac7-40cf-b19a-790e95ccfffa {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.417391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c274bb6f-0ac7-40cf-b19a-790e95ccfffa), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.418137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7c7511f8-aa23-4749-bd75-f6a783bb6328 admin admin] Security group rule updated ['8d4d7d19-af41-48f1-983d-fa2d97aac40f'] Oct 09 00:56:55.706965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Resource SecurityGroup deleted: 4aaae477-9673-4764-96de-2ca0051da504 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.707750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (4aaae477-9673-4764-96de-2ca0051da504), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.708375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4aaae477-9673-4764-96de-2ca0051da504',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:55.731166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4aaae477-9673-4764-96de-2ca0051da504',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:55.732006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Resource SecurityGroupRule deleted: 1f83fa6f-2f49-4691-99d8-36ff7187b669 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.732531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1f83fa6f-2f49-4691-99d8-36ff7187b669), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.733030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Security group rule updated ['4aaae477-9673-4764-96de-2ca0051da504'] Oct 09 00:56:55.733778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Resource SecurityGroupRule deleted: 81711303-a80f-487a-aa95-dbd64636be05 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.734654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (81711303-a80f-487a-aa95-dbd64636be05), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.735623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Security group rule updated ['4aaae477-9673-4764-96de-2ca0051da504'] Oct 09 00:56:55.736110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Resource SecurityGroupRule deleted: 82a863f2-6308-4d0e-b85c-571d842cde70 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.736461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (82a863f2-6308-4d0e-b85c-571d842cde70), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.737572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Security group rule updated ['4aaae477-9673-4764-96de-2ca0051da504'] Oct 09 00:56:55.738129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Resource SecurityGroupRule deleted: a3fd2570-e3b5-4171-8408-5285829f75b8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:55.738654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a3fd2570-e3b5-4171-8408-5285829f75b8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:55.739148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8d31927e-f670-4862-a672-59cc3c267df1 admin admin] Security group rule updated ['4aaae477-9673-4764-96de-2ca0051da504'] Oct 09 00:56:56.018003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:55Z,description='Default security group',id=ff4d0fa7-864b-4c33-8cde-0fdb5a02e339,is_default=True,name='default',project_id='b129a63b5ece4a578c2bcc961efe5060',revision_number=1,rules=[SecurityGroupRule(52dd23fe-599f-422f-af57-1af107b5fbe8),SecurityGroupRule(a6fc4287-9f9c-4bf8-a18e-1da5711331d1),SecurityGroupRule(df66db21-2901-4e51-b603-4d441daee9db),SecurityGroupRule(ed93cb23-63c2-4041-ab2e-83423e34f71a)],shared=False,stateful=True,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:56.019234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (ff4d0fa7-864b-4c33-8cde-0fdb5a02e339), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.020096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:55Z,description=,direction='ingress',ethertype='IPv6',id=52dd23fe-599f-422f-af57-1af107b5fbe8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b129a63b5ece4a578c2bcc961efe5060',protocol=,remote_address_group_id=,remote_group_id=ff4d0fa7-864b-4c33-8cde-0fdb5a02e339,remote_ip_prefix=,revision_number=0,security_group_id=ff4d0fa7-864b-4c33-8cde-0fdb5a02e339,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:56.020720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (52dd23fe-599f-422f-af57-1af107b5fbe8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.021263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Security group rule updated ['ff4d0fa7-864b-4c33-8cde-0fdb5a02e339'] Oct 09 00:56:56.022498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:55Z,description=,direction='ingress',ethertype='IPv4',id=a6fc4287-9f9c-4bf8-a18e-1da5711331d1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b129a63b5ece4a578c2bcc961efe5060',protocol=,remote_address_group_id=,remote_group_id=ff4d0fa7-864b-4c33-8cde-0fdb5a02e339,remote_ip_prefix=,revision_number=0,security_group_id=ff4d0fa7-864b-4c33-8cde-0fdb5a02e339,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:56.023204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a6fc4287-9f9c-4bf8-a18e-1da5711331d1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.023782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Security group rule updated ['ff4d0fa7-864b-4c33-8cde-0fdb5a02e339'] Oct 09 00:56:56.025346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:55Z,description=,direction='egress',ethertype='IPv6',id=df66db21-2901-4e51-b603-4d441daee9db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b129a63b5ece4a578c2bcc961efe5060',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ff4d0fa7-864b-4c33-8cde-0fdb5a02e339,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:56.027444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (df66db21-2901-4e51-b603-4d441daee9db), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.027444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Security group rule updated ['ff4d0fa7-864b-4c33-8cde-0fdb5a02e339'] Oct 09 00:56:56.027444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:55Z,description=,direction='egress',ethertype='IPv4',id=ed93cb23-63c2-4041-ab2e-83423e34f71a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b129a63b5ece4a578c2bcc961efe5060',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ff4d0fa7-864b-4c33-8cde-0fdb5a02e339,updated_at=2022-10-09T00:56:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:56.028443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ed93cb23-63c2-4041-ab2e-83423e34f71a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.028995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b23cb909-2823-4229-8c44-8138d7d714bd admin admin] Security group rule updated ['ff4d0fa7-864b-4c33-8cde-0fdb5a02e339'] Oct 09 00:56:56.327725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Resource SecurityGroup deleted: ff4d0fa7-864b-4c33-8cde-0fdb5a02e339 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:56.328311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (ff4d0fa7-864b-4c33-8cde-0fdb5a02e339), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.328727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ff4d0fa7-864b-4c33-8cde-0fdb5a02e339',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:56.357217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ff4d0fa7-864b-4c33-8cde-0fdb5a02e339',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:56.358411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Resource SecurityGroupRule deleted: 52dd23fe-599f-422f-af57-1af107b5fbe8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:56.358949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (52dd23fe-599f-422f-af57-1af107b5fbe8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.359616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Security group rule updated ['ff4d0fa7-864b-4c33-8cde-0fdb5a02e339'] Oct 09 00:56:56.360305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Resource SecurityGroupRule deleted: a6fc4287-9f9c-4bf8-a18e-1da5711331d1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:56.360984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a6fc4287-9f9c-4bf8-a18e-1da5711331d1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.363042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Security group rule updated ['ff4d0fa7-864b-4c33-8cde-0fdb5a02e339'] Oct 09 00:56:56.363612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Resource SecurityGroupRule deleted: df66db21-2901-4e51-b603-4d441daee9db {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:56.363965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (df66db21-2901-4e51-b603-4d441daee9db), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.364476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Security group rule updated ['ff4d0fa7-864b-4c33-8cde-0fdb5a02e339'] Oct 09 00:56:56.365007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Resource SecurityGroupRule deleted: ed93cb23-63c2-4041-ab2e-83423e34f71a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:56.365349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ed93cb23-63c2-4041-ab2e-83423e34f71a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:56.365666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-baf4637b-dd70-4d14-8d69-e0ef7f08f086 admin admin] Security group rule updated ['ff4d0fa7-864b-4c33-8cde-0fdb5a02e339'] Oct 09 00:56:56.634248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:271 started Oct 09 00:56:56.637494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=958000000,duration_sec=558,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:56.638482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:56.639068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:271 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:56:57.205311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:56Z,description='Default security group',id=086703d2-28ff-43b7-837c-4daafd64e52c,is_default=True,name='default',project_id='9201690b2e83499ea2a735e6c673b8af',revision_number=1,rules=[SecurityGroupRule(39c58332-ce9e-42c2-87c3-835e652b311c),SecurityGroupRule(b0f89df7-5cef-45d8-8af8-9ed1d6a1995e),SecurityGroupRule(c9d33d7e-40e8-4a1b-8be9-0163a049c9cc),SecurityGroupRule(d8d46ceb-51a5-4dc1-aade-b5cb30c0b89c)],shared=False,stateful=True,updated_at=2022-10-09T00:56:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.205728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (086703d2-28ff-43b7-837c-4daafd64e52c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.206362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:56Z,description=,direction='ingress',ethertype='IPv6',id=39c58332-ce9e-42c2-87c3-835e652b311c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9201690b2e83499ea2a735e6c673b8af',protocol=,remote_address_group_id=,remote_group_id=086703d2-28ff-43b7-837c-4daafd64e52c,remote_ip_prefix=,revision_number=0,security_group_id=086703d2-28ff-43b7-837c-4daafd64e52c,updated_at=2022-10-09T00:56:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.206716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (39c58332-ce9e-42c2-87c3-835e652b311c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.207049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Security group rule updated ['086703d2-28ff-43b7-837c-4daafd64e52c'] Oct 09 00:56:57.207785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:56Z,description=,direction='ingress',ethertype='IPv4',id=b0f89df7-5cef-45d8-8af8-9ed1d6a1995e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9201690b2e83499ea2a735e6c673b8af',protocol=,remote_address_group_id=,remote_group_id=086703d2-28ff-43b7-837c-4daafd64e52c,remote_ip_prefix=,revision_number=0,security_group_id=086703d2-28ff-43b7-837c-4daafd64e52c,updated_at=2022-10-09T00:56:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.208138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b0f89df7-5cef-45d8-8af8-9ed1d6a1995e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.208464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Security group rule updated ['086703d2-28ff-43b7-837c-4daafd64e52c'] Oct 09 00:56:57.209120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:56Z,description=,direction='egress',ethertype='IPv6',id=c9d33d7e-40e8-4a1b-8be9-0163a049c9cc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9201690b2e83499ea2a735e6c673b8af',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=086703d2-28ff-43b7-837c-4daafd64e52c,updated_at=2022-10-09T00:56:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.209465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c9d33d7e-40e8-4a1b-8be9-0163a049c9cc), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.209787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Security group rule updated ['086703d2-28ff-43b7-837c-4daafd64e52c'] Oct 09 00:56:57.210436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:56Z,description=,direction='egress',ethertype='IPv4',id=d8d46ceb-51a5-4dc1-aade-b5cb30c0b89c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9201690b2e83499ea2a735e6c673b8af',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=086703d2-28ff-43b7-837c-4daafd64e52c,updated_at=2022-10-09T00:56:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.210785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d8d46ceb-51a5-4dc1-aade-b5cb30c0b89c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.211111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-397e2c99-ddbf-487a-82a7-1c07613fcd99 admin admin] Security group rule updated ['086703d2-28ff-43b7-837c-4daafd64e52c'] Oct 09 00:56:57.344045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 8fe52a88-9c39-4ea8-9d6f-ca693b1da44c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:57.344700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (8fe52a88-9c39-4ea8-9d6f-ca693b1da44c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.481848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Resource SecurityGroup deleted: 086703d2-28ff-43b7-837c-4daafd64e52c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.482216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (086703d2-28ff-43b7-837c-4daafd64e52c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.482664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('086703d2-28ff-43b7-837c-4daafd64e52c',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:57.606624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('086703d2-28ff-43b7-837c-4daafd64e52c',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:57.607089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Resource SecurityGroupRule deleted: 39c58332-ce9e-42c2-87c3-835e652b311c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.607462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (39c58332-ce9e-42c2-87c3-835e652b311c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.607894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Security group rule updated ['086703d2-28ff-43b7-837c-4daafd64e52c'] Oct 09 00:56:57.608287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Resource SecurityGroupRule deleted: b0f89df7-5cef-45d8-8af8-9ed1d6a1995e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.608628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b0f89df7-5cef-45d8-8af8-9ed1d6a1995e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.608948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Security group rule updated ['086703d2-28ff-43b7-837c-4daafd64e52c'] Oct 09 00:56:57.609313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Resource SecurityGroupRule deleted: c9d33d7e-40e8-4a1b-8be9-0163a049c9cc {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.609651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c9d33d7e-40e8-4a1b-8be9-0163a049c9cc), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.609984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Security group rule updated ['086703d2-28ff-43b7-837c-4daafd64e52c'] Oct 09 00:56:57.610322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Resource SecurityGroupRule deleted: d8d46ceb-51a5-4dc1-aade-b5cb30c0b89c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.610856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d8d46ceb-51a5-4dc1-aade-b5cb30c0b89c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.611359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-274cd643-66ca-4506-b393-815e54b59dd0 admin admin] Security group rule updated ['086703d2-28ff-43b7-837c-4daafd64e52c'] Oct 09 00:56:57.648027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 033058db-9b72-4aa7-b12d-bf2294dc0aa3 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:56:57.648451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (033058db-9b72-4aa7-b12d-bf2294dc0aa3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.680268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:57Z,description='Default security group',id=f979d413-0f60-4826-bfd4-dc856c72e632,is_default=True,name='default',project_id='9619db18b00c4670a6bb50e4d3b982ef',revision_number=1,rules=[SecurityGroupRule(225d7249-f2c3-478f-9b52-3b2e128c7b55),SecurityGroupRule(4df05735-8577-4efc-a400-c4e02c72c163),SecurityGroupRule(6ca6c8d7-7a29-411f-90e3-4ba9aacec75d),SecurityGroupRule(92e2188d-923b-4ae3-a787-50469cabe9c4)],shared=False,stateful=True,updated_at=2022-10-09T00:56:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.680901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (f979d413-0f60-4826-bfd4-dc856c72e632), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.681643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:57Z,description=,direction='ingress',ethertype='IPv4',id=225d7249-f2c3-478f-9b52-3b2e128c7b55,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9619db18b00c4670a6bb50e4d3b982ef',protocol=,remote_address_group_id=,remote_group_id=f979d413-0f60-4826-bfd4-dc856c72e632,remote_ip_prefix=,revision_number=0,security_group_id=f979d413-0f60-4826-bfd4-dc856c72e632,updated_at=2022-10-09T00:56:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.682105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (225d7249-f2c3-478f-9b52-3b2e128c7b55), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.682681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Security group rule updated ['f979d413-0f60-4826-bfd4-dc856c72e632'] Oct 09 00:56:57.683855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:57Z,description=,direction='egress',ethertype='IPv4',id=4df05735-8577-4efc-a400-c4e02c72c163,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9619db18b00c4670a6bb50e4d3b982ef',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f979d413-0f60-4826-bfd4-dc856c72e632,updated_at=2022-10-09T00:56:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.684451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4df05735-8577-4efc-a400-c4e02c72c163), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.684974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Security group rule updated ['f979d413-0f60-4826-bfd4-dc856c72e632'] Oct 09 00:56:57.685810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:57Z,description=,direction='egress',ethertype='IPv6',id=6ca6c8d7-7a29-411f-90e3-4ba9aacec75d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9619db18b00c4670a6bb50e4d3b982ef',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f979d413-0f60-4826-bfd4-dc856c72e632,updated_at=2022-10-09T00:56:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.686357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6ca6c8d7-7a29-411f-90e3-4ba9aacec75d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.686861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Security group rule updated ['f979d413-0f60-4826-bfd4-dc856c72e632'] Oct 09 00:56:57.687860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:57Z,description=,direction='ingress',ethertype='IPv6',id=92e2188d-923b-4ae3-a787-50469cabe9c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9619db18b00c4670a6bb50e4d3b982ef',protocol=,remote_address_group_id=,remote_group_id=f979d413-0f60-4826-bfd4-dc856c72e632,remote_ip_prefix=,revision_number=0,security_group_id=f979d413-0f60-4826-bfd4-dc856c72e632,updated_at=2022-10-09T00:56:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:57.688557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (92e2188d-923b-4ae3-a787-50469cabe9c4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.689097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b6a20276-af89-4f4e-92bf-e3b5be2c7803 admin admin] Security group rule updated ['f979d413-0f60-4826-bfd4-dc856c72e632'] Oct 09 00:56:57.864202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Resource SecurityGroup deleted: f979d413-0f60-4826-bfd4-dc856c72e632 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.864581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (f979d413-0f60-4826-bfd4-dc856c72e632), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.865032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f979d413-0f60-4826-bfd4-dc856c72e632',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:57.880673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f979d413-0f60-4826-bfd4-dc856c72e632',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:57.881035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Resource SecurityGroupRule deleted: 225d7249-f2c3-478f-9b52-3b2e128c7b55 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.881365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (225d7249-f2c3-478f-9b52-3b2e128c7b55), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.881728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Security group rule updated ['f979d413-0f60-4826-bfd4-dc856c72e632'] Oct 09 00:56:57.882115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Resource SecurityGroupRule deleted: 4df05735-8577-4efc-a400-c4e02c72c163 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.882484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4df05735-8577-4efc-a400-c4e02c72c163), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.882801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Security group rule updated ['f979d413-0f60-4826-bfd4-dc856c72e632'] Oct 09 00:56:57.883165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Resource SecurityGroupRule deleted: 6ca6c8d7-7a29-411f-90e3-4ba9aacec75d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.883525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6ca6c8d7-7a29-411f-90e3-4ba9aacec75d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.883873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Security group rule updated ['f979d413-0f60-4826-bfd4-dc856c72e632'] Oct 09 00:56:57.884245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Resource SecurityGroupRule deleted: 92e2188d-923b-4ae3-a787-50469cabe9c4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:57.884589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (92e2188d-923b-4ae3-a787-50469cabe9c4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:57.884872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-04c3787d-7479-4411-b55e-493a2b832406 admin admin] Security group rule updated ['f979d413-0f60-4826-bfd4-dc856c72e632'] Oct 09 00:56:58.617446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:56:58Z,description='Default security group',id=48fa25ed-533a-4275-a99e-ca725293b556,is_default=True,name='default',project_id='63fe6805f72c48ef817bef1b2cf2a37b',revision_number=1,rules=[SecurityGroupRule(0249601a-9b39-4dcb-827b-aebf59561ff3),SecurityGroupRule(03a1ac81-a891-4851-85de-4903eae56459),SecurityGroupRule(46d818d4-fc86-4a6a-b308-ec497ad7b8d3),SecurityGroupRule(dc6cb788-98df-407a-9eba-b50ddbd0c3b6)],shared=False,stateful=True,updated_at=2022-10-09T00:56:58Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:58.618092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (48fa25ed-533a-4275-a99e-ca725293b556), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.618429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:58Z,description=,direction='egress',ethertype='IPv4',id=0249601a-9b39-4dcb-827b-aebf59561ff3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='63fe6805f72c48ef817bef1b2cf2a37b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=48fa25ed-533a-4275-a99e-ca725293b556,updated_at=2022-10-09T00:56:58Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:58.619077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0249601a-9b39-4dcb-827b-aebf59561ff3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.619616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Security group rule updated ['48fa25ed-533a-4275-a99e-ca725293b556'] Oct 09 00:56:58.620850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:58Z,description=,direction='ingress',ethertype='IPv4',id=03a1ac81-a891-4851-85de-4903eae56459,normalized_cidr=None,port_range_max=,port_range_min=,project_id='63fe6805f72c48ef817bef1b2cf2a37b',protocol=,remote_address_group_id=,remote_group_id=48fa25ed-533a-4275-a99e-ca725293b556,remote_ip_prefix=,revision_number=0,security_group_id=48fa25ed-533a-4275-a99e-ca725293b556,updated_at=2022-10-09T00:56:58Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:58.621353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (03a1ac81-a891-4851-85de-4903eae56459), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.621836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Security group rule updated ['48fa25ed-533a-4275-a99e-ca725293b556'] Oct 09 00:56:58.622718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:58Z,description=,direction='egress',ethertype='IPv6',id=46d818d4-fc86-4a6a-b308-ec497ad7b8d3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='63fe6805f72c48ef817bef1b2cf2a37b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=48fa25ed-533a-4275-a99e-ca725293b556,updated_at=2022-10-09T00:56:58Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:58.623213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (46d818d4-fc86-4a6a-b308-ec497ad7b8d3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.623715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Security group rule updated ['48fa25ed-533a-4275-a99e-ca725293b556'] Oct 09 00:56:58.625053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:56:58Z,description=,direction='ingress',ethertype='IPv6',id=dc6cb788-98df-407a-9eba-b50ddbd0c3b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='63fe6805f72c48ef817bef1b2cf2a37b',protocol=,remote_address_group_id=,remote_group_id=48fa25ed-533a-4275-a99e-ca725293b556,remote_ip_prefix=,revision_number=0,security_group_id=48fa25ed-533a-4275-a99e-ca725293b556,updated_at=2022-10-09T00:56:58Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:56:58.625560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (dc6cb788-98df-407a-9eba-b50ddbd0c3b6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.626519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-be588031-81e4-486d-91f9-14ec45b5421b admin admin] Security group rule updated ['48fa25ed-533a-4275-a99e-ca725293b556'] Oct 09 00:56:58.636219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:272 started Oct 09 00:56:58.640070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=960000000,duration_sec=560,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:56:58.641530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:56:58.641875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:272 - starting polling. Elapsed:0.007 Oct 09 00:56:58.645199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.649337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:272 - port information retrieved. Elapsed:0.014 Oct 09 00:56:58.649671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:272 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 09 00:56:58.826997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Resource SecurityGroup deleted: 48fa25ed-533a-4275-a99e-ca725293b556 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:58.827878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (48fa25ed-533a-4275-a99e-ca725293b556), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.828622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('48fa25ed-533a-4275-a99e-ca725293b556',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:56:58.844769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('48fa25ed-533a-4275-a99e-ca725293b556',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:56:58.845310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Resource SecurityGroupRule deleted: 0249601a-9b39-4dcb-827b-aebf59561ff3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:58.845896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0249601a-9b39-4dcb-827b-aebf59561ff3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.846534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Security group rule updated ['48fa25ed-533a-4275-a99e-ca725293b556'] Oct 09 00:56:58.847037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Resource SecurityGroupRule deleted: 03a1ac81-a891-4851-85de-4903eae56459 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:58.847697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (03a1ac81-a891-4851-85de-4903eae56459), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.847886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Security group rule updated ['48fa25ed-533a-4275-a99e-ca725293b556'] Oct 09 00:56:58.848284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Resource SecurityGroupRule deleted: 46d818d4-fc86-4a6a-b308-ec497ad7b8d3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:58.848682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (46d818d4-fc86-4a6a-b308-ec497ad7b8d3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.849019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Security group rule updated ['48fa25ed-533a-4275-a99e-ca725293b556'] Oct 09 00:56:58.849290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Resource SecurityGroupRule deleted: dc6cb788-98df-407a-9eba-b50ddbd0c3b6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:56:58.850898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (dc6cb788-98df-407a-9eba-b50ddbd0c3b6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:56:58.851379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ba6ee869-a9ba-48d8-a5cc-82cb373c57d3 admin admin] Security group rule updated ['48fa25ed-533a-4275-a99e-ca725293b556'] Oct 09 00:57:00.636682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:273 started Oct 09 00:57:00.639170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=960000000,duration_sec=562,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:00.640185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:00.640714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:273 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:00.801152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:00Z,description='Default security group',id=fd96e4ce-523b-4cd7-a62f-08d54c379e51,is_default=True,name='default',project_id='02c483e0e68343e0be05cac138769c2c',revision_number=1,rules=[SecurityGroupRule(09ea06d7-1489-4676-aef9-24c24f2748e1),SecurityGroupRule(2c6a7a65-b079-42d7-99d6-66130208259d),SecurityGroupRule(3acd6856-37cd-42b5-ba84-9202711f2b65),SecurityGroupRule(4ae2e66c-2179-4121-9b90-e4d27d9f0c85)],shared=False,stateful=True,updated_at=2022-10-09T00:57:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:00.801930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (fd96e4ce-523b-4cd7-a62f-08d54c379e51), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:00.802587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:00Z,description=,direction='ingress',ethertype='IPv4',id=09ea06d7-1489-4676-aef9-24c24f2748e1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02c483e0e68343e0be05cac138769c2c',protocol=,remote_address_group_id=,remote_group_id=fd96e4ce-523b-4cd7-a62f-08d54c379e51,remote_ip_prefix=,revision_number=0,security_group_id=fd96e4ce-523b-4cd7-a62f-08d54c379e51,updated_at=2022-10-09T00:57:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:00.803074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (09ea06d7-1489-4676-aef9-24c24f2748e1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:00.803412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Security group rule updated ['fd96e4ce-523b-4cd7-a62f-08d54c379e51'] Oct 09 00:57:00.804545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:00Z,description=,direction='egress',ethertype='IPv6',id=2c6a7a65-b079-42d7-99d6-66130208259d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02c483e0e68343e0be05cac138769c2c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fd96e4ce-523b-4cd7-a62f-08d54c379e51,updated_at=2022-10-09T00:57:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:00.804900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2c6a7a65-b079-42d7-99d6-66130208259d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:00.805220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Security group rule updated ['fd96e4ce-523b-4cd7-a62f-08d54c379e51'] Oct 09 00:57:00.805888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:00Z,description=,direction='ingress',ethertype='IPv6',id=3acd6856-37cd-42b5-ba84-9202711f2b65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02c483e0e68343e0be05cac138769c2c',protocol=,remote_address_group_id=,remote_group_id=fd96e4ce-523b-4cd7-a62f-08d54c379e51,remote_ip_prefix=,revision_number=0,security_group_id=fd96e4ce-523b-4cd7-a62f-08d54c379e51,updated_at=2022-10-09T00:57:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:00.806232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3acd6856-37cd-42b5-ba84-9202711f2b65), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:00.806551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Security group rule updated ['fd96e4ce-523b-4cd7-a62f-08d54c379e51'] Oct 09 00:57:00.809944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:00Z,description=,direction='egress',ethertype='IPv4',id=4ae2e66c-2179-4121-9b90-e4d27d9f0c85,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02c483e0e68343e0be05cac138769c2c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fd96e4ce-523b-4cd7-a62f-08d54c379e51,updated_at=2022-10-09T00:57:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:00.811192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4ae2e66c-2179-4121-9b90-e4d27d9f0c85), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:00.811536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b52d07b6-68b7-497d-ba9f-9cfd21dc19e4 admin admin] Security group rule updated ['fd96e4ce-523b-4cd7-a62f-08d54c379e51'] Oct 09 00:57:01.121705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Resource SecurityGroup deleted: fd96e4ce-523b-4cd7-a62f-08d54c379e51 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:01.122945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (fd96e4ce-523b-4cd7-a62f-08d54c379e51), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.123564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fd96e4ce-523b-4cd7-a62f-08d54c379e51',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:01.141364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fd96e4ce-523b-4cd7-a62f-08d54c379e51',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:01.142576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Resource SecurityGroupRule deleted: 09ea06d7-1489-4676-aef9-24c24f2748e1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:01.143857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (09ea06d7-1489-4676-aef9-24c24f2748e1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.143857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Security group rule updated ['fd96e4ce-523b-4cd7-a62f-08d54c379e51'] Oct 09 00:57:01.143857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Resource SecurityGroupRule deleted: 2c6a7a65-b079-42d7-99d6-66130208259d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:01.144341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2c6a7a65-b079-42d7-99d6-66130208259d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.144742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Security group rule updated ['fd96e4ce-523b-4cd7-a62f-08d54c379e51'] Oct 09 00:57:01.145174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Resource SecurityGroupRule deleted: 3acd6856-37cd-42b5-ba84-9202711f2b65 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:01.145583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3acd6856-37cd-42b5-ba84-9202711f2b65), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.146257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Security group rule updated ['fd96e4ce-523b-4cd7-a62f-08d54c379e51'] Oct 09 00:57:01.146709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Resource SecurityGroupRule deleted: 4ae2e66c-2179-4121-9b90-e4d27d9f0c85 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:01.147119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4ae2e66c-2179-4121-9b90-e4d27d9f0c85), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.147436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-52e1d6f2-9c55-4133-a113-71edfe951c1d admin admin] Security group rule updated ['fd96e4ce-523b-4cd7-a62f-08d54c379e51'] Oct 09 00:57:01.851138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:01Z,description='Default security group',id=fd3d022f-2f0e-4346-889a-5960c03d4895,is_default=True,name='default',project_id='ad3618890d6848a781503ee33472cf7a',revision_number=1,rules=[SecurityGroupRule(58869df1-a71c-4b0c-988c-0a67818dcc3a),SecurityGroupRule(69172a38-e83d-4aa5-b0e1-e131d2ac3020),SecurityGroupRule(8c48d29e-862e-45ff-9a67-ec13297bd45a),SecurityGroupRule(e4b40dd0-e3e5-4d02-83ba-e9e7116949d1)],shared=False,stateful=True,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:01.851810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (fd3d022f-2f0e-4346-889a-5960c03d4895), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.852220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:01Z,description=,direction='ingress',ethertype='IPv4',id=58869df1-a71c-4b0c-988c-0a67818dcc3a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ad3618890d6848a781503ee33472cf7a',protocol=,remote_address_group_id=,remote_group_id=fd3d022f-2f0e-4346-889a-5960c03d4895,remote_ip_prefix=,revision_number=0,security_group_id=fd3d022f-2f0e-4346-889a-5960c03d4895,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:01.852585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (58869df1-a71c-4b0c-988c-0a67818dcc3a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.853085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Security group rule updated ['fd3d022f-2f0e-4346-889a-5960c03d4895'] Oct 09 00:57:01.853773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:01Z,description=,direction='egress',ethertype='IPv6',id=69172a38-e83d-4aa5-b0e1-e131d2ac3020,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ad3618890d6848a781503ee33472cf7a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fd3d022f-2f0e-4346-889a-5960c03d4895,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:01.854332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (69172a38-e83d-4aa5-b0e1-e131d2ac3020), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.855029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Security group rule updated ['fd3d022f-2f0e-4346-889a-5960c03d4895'] Oct 09 00:57:01.855945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:01Z,description=,direction='egress',ethertype='IPv4',id=8c48d29e-862e-45ff-9a67-ec13297bd45a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ad3618890d6848a781503ee33472cf7a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fd3d022f-2f0e-4346-889a-5960c03d4895,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:01.857525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8c48d29e-862e-45ff-9a67-ec13297bd45a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.858023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Security group rule updated ['fd3d022f-2f0e-4346-889a-5960c03d4895'] Oct 09 00:57:01.860109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:01Z,description=,direction='ingress',ethertype='IPv6',id=e4b40dd0-e3e5-4d02-83ba-e9e7116949d1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ad3618890d6848a781503ee33472cf7a',protocol=,remote_address_group_id=,remote_group_id=fd3d022f-2f0e-4346-889a-5960c03d4895,remote_ip_prefix=,revision_number=0,security_group_id=fd3d022f-2f0e-4346-889a-5960c03d4895,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:01.860729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e4b40dd0-e3e5-4d02-83ba-e9e7116949d1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:01.861211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-414feb15-7f5d-41f9-8576-c7eba31a1adc admin admin] Security group rule updated ['fd3d022f-2f0e-4346-889a-5960c03d4895'] Oct 09 00:57:02.041958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Resource SecurityGroup deleted: fd3d022f-2f0e-4346-889a-5960c03d4895 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.042622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (fd3d022f-2f0e-4346-889a-5960c03d4895), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.043885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fd3d022f-2f0e-4346-889a-5960c03d4895',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:02.061150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fd3d022f-2f0e-4346-889a-5960c03d4895',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:02.061621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Resource SecurityGroupRule deleted: 58869df1-a71c-4b0c-988c-0a67818dcc3a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.062138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (58869df1-a71c-4b0c-988c-0a67818dcc3a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.062541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Security group rule updated ['fd3d022f-2f0e-4346-889a-5960c03d4895'] Oct 09 00:57:02.062961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Resource SecurityGroupRule deleted: 69172a38-e83d-4aa5-b0e1-e131d2ac3020 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.063307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (69172a38-e83d-4aa5-b0e1-e131d2ac3020), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.063637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Security group rule updated ['fd3d022f-2f0e-4346-889a-5960c03d4895'] Oct 09 00:57:02.064264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Resource SecurityGroupRule deleted: 8c48d29e-862e-45ff-9a67-ec13297bd45a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.064837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8c48d29e-862e-45ff-9a67-ec13297bd45a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.065944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Security group rule updated ['fd3d022f-2f0e-4346-889a-5960c03d4895'] Oct 09 00:57:02.066459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Resource SecurityGroupRule deleted: e4b40dd0-e3e5-4d02-83ba-e9e7116949d1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.066975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e4b40dd0-e3e5-4d02-83ba-e9e7116949d1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.067437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9f705603-da17-489d-8549-038f3f6966e8 admin admin] Security group rule updated ['fd3d022f-2f0e-4346-889a-5960c03d4895'] Oct 09 00:57:02.085575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:01Z,description='Default security group',id=d22d48b6-afac-4f00-8dbd-540d14ddfc75,is_default=True,name='default',project_id='bef1dcb3d43f44de8a3e058b4dee56ab',revision_number=1,rules=[SecurityGroupRule(0b0e6110-2db9-472b-811c-16151d2ec8b7),SecurityGroupRule(3e488999-83c8-4540-b633-a5e505448238),SecurityGroupRule(bc6a3b71-3b5a-4c60-bd13-cbbb67a95f99),SecurityGroupRule(d13fc431-476c-4bb1-baa2-d4b86cafd9a0)],shared=False,stateful=True,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.088799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (d22d48b6-afac-4f00-8dbd-540d14ddfc75), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.089661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:01Z,description=,direction='egress',ethertype='IPv4',id=0b0e6110-2db9-472b-811c-16151d2ec8b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bef1dcb3d43f44de8a3e058b4dee56ab',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d22d48b6-afac-4f00-8dbd-540d14ddfc75,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.090293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0b0e6110-2db9-472b-811c-16151d2ec8b7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.090790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Security group rule updated ['d22d48b6-afac-4f00-8dbd-540d14ddfc75'] Oct 09 00:57:02.091774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:01Z,description=,direction='ingress',ethertype='IPv4',id=3e488999-83c8-4540-b633-a5e505448238,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bef1dcb3d43f44de8a3e058b4dee56ab',protocol=,remote_address_group_id=,remote_group_id=d22d48b6-afac-4f00-8dbd-540d14ddfc75,remote_ip_prefix=,revision_number=0,security_group_id=d22d48b6-afac-4f00-8dbd-540d14ddfc75,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.092413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3e488999-83c8-4540-b633-a5e505448238), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.093478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Security group rule updated ['d22d48b6-afac-4f00-8dbd-540d14ddfc75'] Oct 09 00:57:02.094324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:01Z,description=,direction='ingress',ethertype='IPv6',id=bc6a3b71-3b5a-4c60-bd13-cbbb67a95f99,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bef1dcb3d43f44de8a3e058b4dee56ab',protocol=,remote_address_group_id=,remote_group_id=d22d48b6-afac-4f00-8dbd-540d14ddfc75,remote_ip_prefix=,revision_number=0,security_group_id=d22d48b6-afac-4f00-8dbd-540d14ddfc75,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.095531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (bc6a3b71-3b5a-4c60-bd13-cbbb67a95f99), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.096072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Security group rule updated ['d22d48b6-afac-4f00-8dbd-540d14ddfc75'] Oct 09 00:57:02.096976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:01Z,description=,direction='egress',ethertype='IPv6',id=d13fc431-476c-4bb1-baa2-d4b86cafd9a0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bef1dcb3d43f44de8a3e058b4dee56ab',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d22d48b6-afac-4f00-8dbd-540d14ddfc75,updated_at=2022-10-09T00:57:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.097488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d13fc431-476c-4bb1-baa2-d4b86cafd9a0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.098458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d946a221-9ac7-4880-928c-109a1036d1bc admin admin] Security group rule updated ['d22d48b6-afac-4f00-8dbd-540d14ddfc75'] Oct 09 00:57:02.337596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Resource SecurityGroup deleted: d22d48b6-afac-4f00-8dbd-540d14ddfc75 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.338799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (d22d48b6-afac-4f00-8dbd-540d14ddfc75), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.339457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a093895f-b518-41e5-8593-65250036573b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d22d48b6-afac-4f00-8dbd-540d14ddfc75',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:02.367383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a093895f-b518-41e5-8593-65250036573b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d22d48b6-afac-4f00-8dbd-540d14ddfc75',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:02.368071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Resource SecurityGroupRule deleted: 0b0e6110-2db9-472b-811c-16151d2ec8b7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.368606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0b0e6110-2db9-472b-811c-16151d2ec8b7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.371396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Security group rule updated ['d22d48b6-afac-4f00-8dbd-540d14ddfc75'] Oct 09 00:57:02.372016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Resource SecurityGroupRule deleted: 3e488999-83c8-4540-b633-a5e505448238 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.372540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3e488999-83c8-4540-b633-a5e505448238), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.374258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Security group rule updated ['d22d48b6-afac-4f00-8dbd-540d14ddfc75'] Oct 09 00:57:02.374848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Resource SecurityGroupRule deleted: bc6a3b71-3b5a-4c60-bd13-cbbb67a95f99 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.377455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (bc6a3b71-3b5a-4c60-bd13-cbbb67a95f99), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.378489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Security group rule updated ['d22d48b6-afac-4f00-8dbd-540d14ddfc75'] Oct 09 00:57:02.379501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Resource SecurityGroupRule deleted: d13fc431-476c-4bb1-baa2-d4b86cafd9a0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:02.382317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d13fc431-476c-4bb1-baa2-d4b86cafd9a0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.382813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a093895f-b518-41e5-8593-65250036573b admin admin] Security group rule updated ['d22d48b6-afac-4f00-8dbd-540d14ddfc75'] Oct 09 00:57:02.638406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:274 started Oct 09 00:57:02.642028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=962000000,duration_sec=564,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:02.642593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:02.643975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:274 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:57:02.973987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:02Z,description='Default security group',id=64536281-4162-4eff-aa1c-d1e523b8a465,is_default=True,name='default',project_id='d4df28446e714a29b69ebc706ea6be93',revision_number=1,rules=[SecurityGroupRule(24bc2f26-d9d5-4eb9-a757-8f292e663eb1),SecurityGroupRule(6de0ddeb-187c-4d0d-b90e-d5204b3e1e49),SecurityGroupRule(72668701-c6d8-489f-8379-fe84a9995a21),SecurityGroupRule(dd2ccd44-99a1-45a6-8d50-beb1fbe10a28)],shared=False,stateful=True,updated_at=2022-10-09T00:57:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.974664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (64536281-4162-4eff-aa1c-d1e523b8a465), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.975023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:02Z,description=,direction='ingress',ethertype='IPv6',id=24bc2f26-d9d5-4eb9-a757-8f292e663eb1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4df28446e714a29b69ebc706ea6be93',protocol=,remote_address_group_id=,remote_group_id=64536281-4162-4eff-aa1c-d1e523b8a465,remote_ip_prefix=,revision_number=0,security_group_id=64536281-4162-4eff-aa1c-d1e523b8a465,updated_at=2022-10-09T00:57:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.976286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (24bc2f26-d9d5-4eb9-a757-8f292e663eb1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.976635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Security group rule updated ['64536281-4162-4eff-aa1c-d1e523b8a465'] Oct 09 00:57:02.977321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:02Z,description=,direction='ingress',ethertype='IPv4',id=6de0ddeb-187c-4d0d-b90e-d5204b3e1e49,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4df28446e714a29b69ebc706ea6be93',protocol=,remote_address_group_id=,remote_group_id=64536281-4162-4eff-aa1c-d1e523b8a465,remote_ip_prefix=,revision_number=0,security_group_id=64536281-4162-4eff-aa1c-d1e523b8a465,updated_at=2022-10-09T00:57:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.977827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6de0ddeb-187c-4d0d-b90e-d5204b3e1e49), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.978308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Security group rule updated ['64536281-4162-4eff-aa1c-d1e523b8a465'] Oct 09 00:57:02.978970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:02Z,description=,direction='egress',ethertype='IPv6',id=72668701-c6d8-489f-8379-fe84a9995a21,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4df28446e714a29b69ebc706ea6be93',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=64536281-4162-4eff-aa1c-d1e523b8a465,updated_at=2022-10-09T00:57:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.979318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (72668701-c6d8-489f-8379-fe84a9995a21), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.979839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Security group rule updated ['64536281-4162-4eff-aa1c-d1e523b8a465'] Oct 09 00:57:02.980492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:02Z,description=,direction='egress',ethertype='IPv4',id=dd2ccd44-99a1-45a6-8d50-beb1fbe10a28,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4df28446e714a29b69ebc706ea6be93',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=64536281-4162-4eff-aa1c-d1e523b8a465,updated_at=2022-10-09T00:57:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:02.981007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (dd2ccd44-99a1-45a6-8d50-beb1fbe10a28), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:02.981334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-571dbe22-7544-439e-ba18-07dbcd187ae5 admin admin] Security group rule updated ['64536281-4162-4eff-aa1c-d1e523b8a465'] Oct 09 00:57:03.185817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Resource SecurityGroup deleted: 64536281-4162-4eff-aa1c-d1e523b8a465 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:03.186728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (64536281-4162-4eff-aa1c-d1e523b8a465), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:03.187619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('64536281-4162-4eff-aa1c-d1e523b8a465',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:03.276633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('64536281-4162-4eff-aa1c-d1e523b8a465',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:03.277100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Resource SecurityGroupRule deleted: 24bc2f26-d9d5-4eb9-a757-8f292e663eb1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:03.277640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (24bc2f26-d9d5-4eb9-a757-8f292e663eb1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:03.277964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Security group rule updated ['64536281-4162-4eff-aa1c-d1e523b8a465'] Oct 09 00:57:03.278563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Resource SecurityGroupRule deleted: 6de0ddeb-187c-4d0d-b90e-d5204b3e1e49 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:03.279077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6de0ddeb-187c-4d0d-b90e-d5204b3e1e49), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:03.279544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Security group rule updated ['64536281-4162-4eff-aa1c-d1e523b8a465'] Oct 09 00:57:03.280078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Resource SecurityGroupRule deleted: 72668701-c6d8-489f-8379-fe84a9995a21 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:03.280759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (72668701-c6d8-489f-8379-fe84a9995a21), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:03.281485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Security group rule updated ['64536281-4162-4eff-aa1c-d1e523b8a465'] Oct 09 00:57:03.282217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Resource SecurityGroupRule deleted: dd2ccd44-99a1-45a6-8d50-beb1fbe10a28 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:03.282838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (dd2ccd44-99a1-45a6-8d50-beb1fbe10a28), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:03.283303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-94a71295-eb9e-442d-9b11-626554c37edf admin admin] Security group rule updated ['64536281-4162-4eff-aa1c-d1e523b8a465'] Oct 09 00:57:04.640382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:275 started Oct 09 00:57:04.643559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=964000000,duration_sec=566,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:04.644168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:04.644572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:275 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:57:06.640274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:276 started Oct 09 00:57:06.644516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=964000000,duration_sec=568,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:06.645481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:06.646017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:276 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:57:06.888711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:06Z,description='Default security group',id=eae1a7a4-0c80-4f6d-bb66-96753be3e92f,is_default=True,name='default',project_id='c6be54a4bceb4bc8b03ba71439906556',revision_number=1,rules=[SecurityGroupRule(02251cf1-a779-42a3-bb3c-9f29e9fea9d3),SecurityGroupRule(0fd8872f-cea2-4282-a1ac-d113f9261786),SecurityGroupRule(4ed1ecf4-218e-4cd0-a215-589bebfb8d9b),SecurityGroupRule(df1074eb-3982-4869-80e1-2bad5b526f65)],shared=False,stateful=True,updated_at=2022-10-09T00:57:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:06.889487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (eae1a7a4-0c80-4f6d-bb66-96753be3e92f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:06.890220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:06Z,description=,direction='ingress',ethertype='IPv6',id=02251cf1-a779-42a3-bb3c-9f29e9fea9d3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6be54a4bceb4bc8b03ba71439906556',protocol=,remote_address_group_id=,remote_group_id=eae1a7a4-0c80-4f6d-bb66-96753be3e92f,remote_ip_prefix=,revision_number=0,security_group_id=eae1a7a4-0c80-4f6d-bb66-96753be3e92f,updated_at=2022-10-09T00:57:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:06.891080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (02251cf1-a779-42a3-bb3c-9f29e9fea9d3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:06.891678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Security group rule updated ['eae1a7a4-0c80-4f6d-bb66-96753be3e92f'] Oct 09 00:57:06.892563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:06Z,description=,direction='ingress',ethertype='IPv4',id=0fd8872f-cea2-4282-a1ac-d113f9261786,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6be54a4bceb4bc8b03ba71439906556',protocol=,remote_address_group_id=,remote_group_id=eae1a7a4-0c80-4f6d-bb66-96753be3e92f,remote_ip_prefix=,revision_number=0,security_group_id=eae1a7a4-0c80-4f6d-bb66-96753be3e92f,updated_at=2022-10-09T00:57:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:06.893143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0fd8872f-cea2-4282-a1ac-d113f9261786), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:06.894883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Security group rule updated ['eae1a7a4-0c80-4f6d-bb66-96753be3e92f'] Oct 09 00:57:06.895834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:06Z,description=,direction='egress',ethertype='IPv6',id=4ed1ecf4-218e-4cd0-a215-589bebfb8d9b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6be54a4bceb4bc8b03ba71439906556',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eae1a7a4-0c80-4f6d-bb66-96753be3e92f,updated_at=2022-10-09T00:57:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:06.896894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4ed1ecf4-218e-4cd0-a215-589bebfb8d9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:06.897454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Security group rule updated ['eae1a7a4-0c80-4f6d-bb66-96753be3e92f'] Oct 09 00:57:06.900381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:06Z,description=,direction='egress',ethertype='IPv4',id=df1074eb-3982-4869-80e1-2bad5b526f65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6be54a4bceb4bc8b03ba71439906556',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eae1a7a4-0c80-4f6d-bb66-96753be3e92f,updated_at=2022-10-09T00:57:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:06.900835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (df1074eb-3982-4869-80e1-2bad5b526f65), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:06.901229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bdc0af9c-7045-49e3-a8cb-954dcb4c0b96 admin admin] Security group rule updated ['eae1a7a4-0c80-4f6d-bb66-96753be3e92f'] Oct 09 00:57:07.049742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Resource SecurityGroup deleted: eae1a7a4-0c80-4f6d-bb66-96753be3e92f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.050410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (eae1a7a4-0c80-4f6d-bb66-96753be3e92f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.051065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('eae1a7a4-0c80-4f6d-bb66-96753be3e92f',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:07.065750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('eae1a7a4-0c80-4f6d-bb66-96753be3e92f',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:07.067516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Resource SecurityGroupRule deleted: 02251cf1-a779-42a3-bb3c-9f29e9fea9d3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.068287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (02251cf1-a779-42a3-bb3c-9f29e9fea9d3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.068836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Security group rule updated ['eae1a7a4-0c80-4f6d-bb66-96753be3e92f'] Oct 09 00:57:07.070385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Resource SecurityGroupRule deleted: 0fd8872f-cea2-4282-a1ac-d113f9261786 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.071471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0fd8872f-cea2-4282-a1ac-d113f9261786), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.072639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Security group rule updated ['eae1a7a4-0c80-4f6d-bb66-96753be3e92f'] Oct 09 00:57:07.073899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Resource SecurityGroupRule deleted: 4ed1ecf4-218e-4cd0-a215-589bebfb8d9b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.075532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4ed1ecf4-218e-4cd0-a215-589bebfb8d9b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.076150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Security group rule updated ['eae1a7a4-0c80-4f6d-bb66-96753be3e92f'] Oct 09 00:57:07.077106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Resource SecurityGroupRule deleted: df1074eb-3982-4869-80e1-2bad5b526f65 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.077771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (df1074eb-3982-4869-80e1-2bad5b526f65), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.082286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d20b6a51-9fdc-4c09-941a-7f8e3ec46f0d admin admin] Security group rule updated ['eae1a7a4-0c80-4f6d-bb66-96753be3e92f'] Oct 09 00:57:07.460073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:07Z,description='Default security group',id=5582be71-3427-4086-90cb-c4bc657e2b0e,is_default=True,name='default',project_id='6824f2b206d44e33b37c484dcea0e96f',revision_number=1,rules=[SecurityGroupRule(3d7fbcc5-94d1-497b-a960-fc68a1aa04fd),SecurityGroupRule(57a99059-3955-455b-8601-1df8a4a034f1),SecurityGroupRule(b76f68a3-1f7e-4fd9-b64b-f5cba362102c),SecurityGroupRule(b88eb8b8-74b0-4402-b7c7-999d18736b8e)],shared=False,stateful=True,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:07.460904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (5582be71-3427-4086-90cb-c4bc657e2b0e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.461991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:07Z,description=,direction='ingress',ethertype='IPv4',id=3d7fbcc5-94d1-497b-a960-fc68a1aa04fd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6824f2b206d44e33b37c484dcea0e96f',protocol=,remote_address_group_id=,remote_group_id=5582be71-3427-4086-90cb-c4bc657e2b0e,remote_ip_prefix=,revision_number=0,security_group_id=5582be71-3427-4086-90cb-c4bc657e2b0e,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:07.462509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3d7fbcc5-94d1-497b-a960-fc68a1aa04fd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.463095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Security group rule updated ['5582be71-3427-4086-90cb-c4bc657e2b0e'] Oct 09 00:57:07.464234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:07Z,description=,direction='egress',ethertype='IPv6',id=57a99059-3955-455b-8601-1df8a4a034f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6824f2b206d44e33b37c484dcea0e96f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5582be71-3427-4086-90cb-c4bc657e2b0e,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:07.465129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (57a99059-3955-455b-8601-1df8a4a034f1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.465603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Security group rule updated ['5582be71-3427-4086-90cb-c4bc657e2b0e'] Oct 09 00:57:07.466422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:07Z,description=,direction='egress',ethertype='IPv4',id=b76f68a3-1f7e-4fd9-b64b-f5cba362102c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6824f2b206d44e33b37c484dcea0e96f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5582be71-3427-4086-90cb-c4bc657e2b0e,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:07.468419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b76f68a3-1f7e-4fd9-b64b-f5cba362102c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.468963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Security group rule updated ['5582be71-3427-4086-90cb-c4bc657e2b0e'] Oct 09 00:57:07.472442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:07Z,description=,direction='ingress',ethertype='IPv6',id=b88eb8b8-74b0-4402-b7c7-999d18736b8e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6824f2b206d44e33b37c484dcea0e96f',protocol=,remote_address_group_id=,remote_group_id=5582be71-3427-4086-90cb-c4bc657e2b0e,remote_ip_prefix=,revision_number=0,security_group_id=5582be71-3427-4086-90cb-c4bc657e2b0e,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:07.473775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b88eb8b8-74b0-4402-b7c7-999d18736b8e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.474380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-96c0d666-9ea7-41a5-8376-3f882c4d57b8 admin admin] Security group rule updated ['5582be71-3427-4086-90cb-c4bc657e2b0e'] Oct 09 00:57:07.873859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Resource SecurityGroup deleted: 5582be71-3427-4086-90cb-c4bc657e2b0e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.874493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (5582be71-3427-4086-90cb-c4bc657e2b0e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.875245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5582be71-3427-4086-90cb-c4bc657e2b0e',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:07.947489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5582be71-3427-4086-90cb-c4bc657e2b0e',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:07.948216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Resource SecurityGroupRule deleted: 3d7fbcc5-94d1-497b-a960-fc68a1aa04fd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.949493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3d7fbcc5-94d1-497b-a960-fc68a1aa04fd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.950634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Security group rule updated ['5582be71-3427-4086-90cb-c4bc657e2b0e'] Oct 09 00:57:07.951296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Resource SecurityGroupRule deleted: 57a99059-3955-455b-8601-1df8a4a034f1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.952152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (57a99059-3955-455b-8601-1df8a4a034f1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.953387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Security group rule updated ['5582be71-3427-4086-90cb-c4bc657e2b0e'] Oct 09 00:57:07.955867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Resource SecurityGroupRule deleted: b76f68a3-1f7e-4fd9-b64b-f5cba362102c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.958017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b76f68a3-1f7e-4fd9-b64b-f5cba362102c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.959161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Security group rule updated ['5582be71-3427-4086-90cb-c4bc657e2b0e'] Oct 09 00:57:07.959935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Resource SecurityGroupRule deleted: b88eb8b8-74b0-4402-b7c7-999d18736b8e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:07.960800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b88eb8b8-74b0-4402-b7c7-999d18736b8e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:07.961465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ab6775be-798f-4c71-a1a1-2ba5e1731abe admin admin] Security group rule updated ['5582be71-3427-4086-90cb-c4bc657e2b0e'] Oct 09 00:57:08.167021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:07Z,description='Default security group',id=13cbe547-0398-47ca-87bb-c915cdeac3d3,is_default=True,name='default',project_id='d8abf6d39eac40c28c62cd3a8a7d250f',revision_number=1,rules=[SecurityGroupRule(28f2c632-8e74-4961-9c4a-190d163a9ff7),SecurityGroupRule(83ccb132-90f0-4907-95d2-246574b0c9a4),SecurityGroupRule(914a0e3a-7ffb-4153-a558-81efcf1af9a1),SecurityGroupRule(9fa93adc-92f8-45e9-8bea-4310ae0f46c4)],shared=False,stateful=True,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.167405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (13cbe547-0398-47ca-87bb-c915cdeac3d3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.168069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:07Z,description=,direction='ingress',ethertype='IPv6',id=28f2c632-8e74-4961-9c4a-190d163a9ff7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d8abf6d39eac40c28c62cd3a8a7d250f',protocol=,remote_address_group_id=,remote_group_id=13cbe547-0398-47ca-87bb-c915cdeac3d3,remote_ip_prefix=,revision_number=0,security_group_id=13cbe547-0398-47ca-87bb-c915cdeac3d3,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.168430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (28f2c632-8e74-4961-9c4a-190d163a9ff7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.168764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Security group rule updated ['13cbe547-0398-47ca-87bb-c915cdeac3d3'] Oct 09 00:57:08.169684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:07Z,description=,direction='egress',ethertype='IPv6',id=83ccb132-90f0-4907-95d2-246574b0c9a4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d8abf6d39eac40c28c62cd3a8a7d250f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=13cbe547-0398-47ca-87bb-c915cdeac3d3,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.170233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (83ccb132-90f0-4907-95d2-246574b0c9a4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.170870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Security group rule updated ['13cbe547-0398-47ca-87bb-c915cdeac3d3'] Oct 09 00:57:08.171706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:07Z,description=,direction='egress',ethertype='IPv4',id=914a0e3a-7ffb-4153-a558-81efcf1af9a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d8abf6d39eac40c28c62cd3a8a7d250f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=13cbe547-0398-47ca-87bb-c915cdeac3d3,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.172270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (914a0e3a-7ffb-4153-a558-81efcf1af9a1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.172768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Security group rule updated ['13cbe547-0398-47ca-87bb-c915cdeac3d3'] Oct 09 00:57:08.174097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:07Z,description=,direction='ingress',ethertype='IPv4',id=9fa93adc-92f8-45e9-8bea-4310ae0f46c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d8abf6d39eac40c28c62cd3a8a7d250f',protocol=,remote_address_group_id=,remote_group_id=13cbe547-0398-47ca-87bb-c915cdeac3d3,remote_ip_prefix=,revision_number=0,security_group_id=13cbe547-0398-47ca-87bb-c915cdeac3d3,updated_at=2022-10-09T00:57:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.175697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9fa93adc-92f8-45e9-8bea-4310ae0f46c4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.176279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-079a2a3e-5018-4201-9b4c-0c2fb7631f44 admin admin] Security group rule updated ['13cbe547-0398-47ca-87bb-c915cdeac3d3'] Oct 09 00:57:08.642011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:277 started Oct 09 00:57:08.645270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=966000000,duration_sec=570,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:08.645852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:08.646331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:277 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:08.974698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:08Z,description='Default security group',id=508a6da7-00ca-46b6-9b75-747a89262e6f,is_default=True,name='default',project_id='5260f11ec8f645cba5394181e4d191cf',revision_number=1,rules=[SecurityGroupRule(533e92fd-eba8-4c59-b758-ee8c3dbff248),SecurityGroupRule(67a321e4-a75e-4117-b955-949180cabf04),SecurityGroupRule(ab4d2271-06b4-4734-9bd7-e35f383151d8),SecurityGroupRule(f9e5482c-98ba-4fe5-9738-ba4d73e520de)],shared=False,stateful=True,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.975828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (508a6da7-00ca-46b6-9b75-747a89262e6f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.976642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:08Z,description=,direction='egress',ethertype='IPv4',id=533e92fd-eba8-4c59-b758-ee8c3dbff248,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5260f11ec8f645cba5394181e4d191cf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=508a6da7-00ca-46b6-9b75-747a89262e6f,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.977227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (533e92fd-eba8-4c59-b758-ee8c3dbff248), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.977746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Security group rule updated ['508a6da7-00ca-46b6-9b75-747a89262e6f'] Oct 09 00:57:08.978610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:08Z,description=,direction='ingress',ethertype='IPv6',id=67a321e4-a75e-4117-b955-949180cabf04,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5260f11ec8f645cba5394181e4d191cf',protocol=,remote_address_group_id=,remote_group_id=508a6da7-00ca-46b6-9b75-747a89262e6f,remote_ip_prefix=,revision_number=0,security_group_id=508a6da7-00ca-46b6-9b75-747a89262e6f,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.979156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (67a321e4-a75e-4117-b955-949180cabf04), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.979704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Security group rule updated ['508a6da7-00ca-46b6-9b75-747a89262e6f'] Oct 09 00:57:08.980616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:08Z,description=,direction='ingress',ethertype='IPv4',id=ab4d2271-06b4-4734-9bd7-e35f383151d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5260f11ec8f645cba5394181e4d191cf',protocol=,remote_address_group_id=,remote_group_id=508a6da7-00ca-46b6-9b75-747a89262e6f,remote_ip_prefix=,revision_number=0,security_group_id=508a6da7-00ca-46b6-9b75-747a89262e6f,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.981178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ab4d2271-06b4-4734-9bd7-e35f383151d8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.984073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Security group rule updated ['508a6da7-00ca-46b6-9b75-747a89262e6f'] Oct 09 00:57:08.985221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:08Z,description=,direction='egress',ethertype='IPv6',id=f9e5482c-98ba-4fe5-9738-ba4d73e520de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5260f11ec8f645cba5394181e4d191cf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=508a6da7-00ca-46b6-9b75-747a89262e6f,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:08.985690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f9e5482c-98ba-4fe5-9738-ba4d73e520de), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.986071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29122026-4fc1-4e51-af38-b1ffb24edcde admin admin] Security group rule updated ['508a6da7-00ca-46b6-9b75-747a89262e6f'] Oct 09 00:57:08.997570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Resource SecurityGroup deleted: 13cbe547-0398-47ca-87bb-c915cdeac3d3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:08.997570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (13cbe547-0398-47ca-87bb-c915cdeac3d3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:08.997570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('13cbe547-0398-47ca-87bb-c915cdeac3d3',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:09.017636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('13cbe547-0398-47ca-87bb-c915cdeac3d3',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:09.018897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Resource SecurityGroupRule deleted: 28f2c632-8e74-4961-9c4a-190d163a9ff7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.019496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (28f2c632-8e74-4961-9c4a-190d163a9ff7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.020059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Security group rule updated ['13cbe547-0398-47ca-87bb-c915cdeac3d3'] Oct 09 00:57:09.020648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Resource SecurityGroupRule deleted: 83ccb132-90f0-4907-95d2-246574b0c9a4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.021221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (83ccb132-90f0-4907-95d2-246574b0c9a4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.021747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Security group rule updated ['13cbe547-0398-47ca-87bb-c915cdeac3d3'] Oct 09 00:57:09.022347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Resource SecurityGroupRule deleted: 914a0e3a-7ffb-4153-a558-81efcf1af9a1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.036289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (914a0e3a-7ffb-4153-a558-81efcf1af9a1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.037114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Security group rule updated ['13cbe547-0398-47ca-87bb-c915cdeac3d3'] Oct 09 00:57:09.037750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Resource SecurityGroupRule deleted: 9fa93adc-92f8-45e9-8bea-4310ae0f46c4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.038335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9fa93adc-92f8-45e9-8bea-4310ae0f46c4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.038734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9ed8a68d-d650-47d1-b878-6ee306fc91af admin admin] Security group rule updated ['13cbe547-0398-47ca-87bb-c915cdeac3d3'] Oct 09 00:57:09.057196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:08Z,description='Default security group',id=521c2f04-15bd-4300-a413-97b2cd4bee23,is_default=True,name='default',project_id='349ac70969174f8db0577dc4a138970e',revision_number=1,rules=[SecurityGroupRule(1232ed88-4d15-491d-bdc9-f28379892d14),SecurityGroupRule(1ad362f2-2aee-42d2-93e5-59012457f7a0),SecurityGroupRule(29979bd7-dda8-4e70-be59-3a48fd31655e),SecurityGroupRule(65ddb153-b380-4bee-8086-e1fbf6996251)],shared=False,stateful=True,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:09.057923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (521c2f04-15bd-4300-a413-97b2cd4bee23), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.059137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:08Z,description=,direction='egress',ethertype='IPv6',id=1232ed88-4d15-491d-bdc9-f28379892d14,normalized_cidr=None,port_range_max=,port_range_min=,project_id='349ac70969174f8db0577dc4a138970e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=521c2f04-15bd-4300-a413-97b2cd4bee23,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:09.059853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1232ed88-4d15-491d-bdc9-f28379892d14), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.060447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Security group rule updated ['521c2f04-15bd-4300-a413-97b2cd4bee23'] Oct 09 00:57:09.061340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:08Z,description=,direction='ingress',ethertype='IPv6',id=1ad362f2-2aee-42d2-93e5-59012457f7a0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='349ac70969174f8db0577dc4a138970e',protocol=,remote_address_group_id=,remote_group_id=521c2f04-15bd-4300-a413-97b2cd4bee23,remote_ip_prefix=,revision_number=0,security_group_id=521c2f04-15bd-4300-a413-97b2cd4bee23,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:09.061931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1ad362f2-2aee-42d2-93e5-59012457f7a0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.062460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Security group rule updated ['521c2f04-15bd-4300-a413-97b2cd4bee23'] Oct 09 00:57:09.063311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:08Z,description=,direction='ingress',ethertype='IPv4',id=29979bd7-dda8-4e70-be59-3a48fd31655e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='349ac70969174f8db0577dc4a138970e',protocol=,remote_address_group_id=,remote_group_id=521c2f04-15bd-4300-a413-97b2cd4bee23,remote_ip_prefix=,revision_number=0,security_group_id=521c2f04-15bd-4300-a413-97b2cd4bee23,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:09.064098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (29979bd7-dda8-4e70-be59-3a48fd31655e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.065898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Security group rule updated ['521c2f04-15bd-4300-a413-97b2cd4bee23'] Oct 09 00:57:09.066755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:08Z,description=,direction='egress',ethertype='IPv4',id=65ddb153-b380-4bee-8086-e1fbf6996251,normalized_cidr=None,port_range_max=,port_range_min=,project_id='349ac70969174f8db0577dc4a138970e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=521c2f04-15bd-4300-a413-97b2cd4bee23,updated_at=2022-10-09T00:57:08Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:09.067406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (65ddb153-b380-4bee-8086-e1fbf6996251), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.067941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dd67a721-b59d-48a6-87e8-120cac996521 admin admin] Security group rule updated ['521c2f04-15bd-4300-a413-97b2cd4bee23'] Oct 09 00:57:09.200925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Resource SecurityGroup deleted: 521c2f04-15bd-4300-a413-97b2cd4bee23 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.201305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (521c2f04-15bd-4300-a413-97b2cd4bee23), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.201750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('521c2f04-15bd-4300-a413-97b2cd4bee23',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:09.221674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('521c2f04-15bd-4300-a413-97b2cd4bee23',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:09.222319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Resource SecurityGroupRule deleted: 1232ed88-4d15-491d-bdc9-f28379892d14 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.222855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1232ed88-4d15-491d-bdc9-f28379892d14), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.223332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Security group rule updated ['521c2f04-15bd-4300-a413-97b2cd4bee23'] Oct 09 00:57:09.223917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Resource SecurityGroupRule deleted: 1ad362f2-2aee-42d2-93e5-59012457f7a0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.224275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1ad362f2-2aee-42d2-93e5-59012457f7a0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.224640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Security group rule updated ['521c2f04-15bd-4300-a413-97b2cd4bee23'] Oct 09 00:57:09.224960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Resource SecurityGroupRule deleted: 29979bd7-dda8-4e70-be59-3a48fd31655e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.225299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (29979bd7-dda8-4e70-be59-3a48fd31655e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.225615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Security group rule updated ['521c2f04-15bd-4300-a413-97b2cd4bee23'] Oct 09 00:57:09.226012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Resource SecurityGroupRule deleted: 65ddb153-b380-4bee-8086-e1fbf6996251 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.226332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (65ddb153-b380-4bee-8086-e1fbf6996251), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.226641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4db6e770-a4fa-489f-bac1-d698cd5d9f2b admin admin] Security group rule updated ['521c2f04-15bd-4300-a413-97b2cd4bee23'] Oct 09 00:57:09.371714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Resource SecurityGroup deleted: 508a6da7-00ca-46b6-9b75-747a89262e6f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.372099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (508a6da7-00ca-46b6-9b75-747a89262e6f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.372624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('508a6da7-00ca-46b6-9b75-747a89262e6f',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:09.391801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('508a6da7-00ca-46b6-9b75-747a89262e6f',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:09.392271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Resource SecurityGroupRule deleted: 533e92fd-eba8-4c59-b758-ee8c3dbff248 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.392758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (533e92fd-eba8-4c59-b758-ee8c3dbff248), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.393098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Security group rule updated ['508a6da7-00ca-46b6-9b75-747a89262e6f'] Oct 09 00:57:09.394062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Resource SecurityGroupRule deleted: 67a321e4-a75e-4117-b955-949180cabf04 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.394409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (67a321e4-a75e-4117-b955-949180cabf04), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.394729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Security group rule updated ['508a6da7-00ca-46b6-9b75-747a89262e6f'] Oct 09 00:57:09.395110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Resource SecurityGroupRule deleted: ab4d2271-06b4-4734-9bd7-e35f383151d8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.395434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ab4d2271-06b4-4734-9bd7-e35f383151d8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.395773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Security group rule updated ['508a6da7-00ca-46b6-9b75-747a89262e6f'] Oct 09 00:57:09.396137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Resource SecurityGroupRule deleted: f9e5482c-98ba-4fe5-9738-ba4d73e520de {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:09.396473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f9e5482c-98ba-4fe5-9738-ba4d73e520de), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:09.396787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cf2780b6-22f5-499c-8da5-39aae58fce22 admin admin] Security group rule updated ['508a6da7-00ca-46b6-9b75-747a89262e6f'] Oct 09 00:57:10.172470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:09Z,description='Default security group',id=871583be-00b2-479a-9441-ff11209d6b9b,is_default=True,name='default',project_id='69bf73bbee1444febc675e813fd9af0c',revision_number=1,rules=[SecurityGroupRule(a31450a2-6bb6-473c-b171-603dadb292ed),SecurityGroupRule(a8be2a19-b872-49e5-8df0-aee6b4da62b1),SecurityGroupRule(d0d907e6-3cbd-4b24-b42f-2f75b901435a),SecurityGroupRule(d4a1a899-98b8-49c3-be41-9f2675ddfb71)],shared=False,stateful=True,updated_at=2022-10-09T00:57:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:10.175265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (871583be-00b2-479a-9441-ff11209d6b9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.176243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:09Z,description=,direction='ingress',ethertype='IPv6',id=a31450a2-6bb6-473c-b171-603dadb292ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69bf73bbee1444febc675e813fd9af0c',protocol=,remote_address_group_id=,remote_group_id=871583be-00b2-479a-9441-ff11209d6b9b,remote_ip_prefix=,revision_number=0,security_group_id=871583be-00b2-479a-9441-ff11209d6b9b,updated_at=2022-10-09T00:57:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:10.176967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a31450a2-6bb6-473c-b171-603dadb292ed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.177738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Security group rule updated ['871583be-00b2-479a-9441-ff11209d6b9b'] Oct 09 00:57:10.179002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:09Z,description=,direction='egress',ethertype='IPv6',id=a8be2a19-b872-49e5-8df0-aee6b4da62b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69bf73bbee1444febc675e813fd9af0c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=871583be-00b2-479a-9441-ff11209d6b9b,updated_at=2022-10-09T00:57:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:10.179679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a8be2a19-b872-49e5-8df0-aee6b4da62b1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.181009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Security group rule updated ['871583be-00b2-479a-9441-ff11209d6b9b'] Oct 09 00:57:10.182030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:09Z,description=,direction='egress',ethertype='IPv4',id=d0d907e6-3cbd-4b24-b42f-2f75b901435a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69bf73bbee1444febc675e813fd9af0c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=871583be-00b2-479a-9441-ff11209d6b9b,updated_at=2022-10-09T00:57:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:10.183024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d0d907e6-3cbd-4b24-b42f-2f75b901435a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.183971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Security group rule updated ['871583be-00b2-479a-9441-ff11209d6b9b'] Oct 09 00:57:10.186928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:09Z,description=,direction='ingress',ethertype='IPv4',id=d4a1a899-98b8-49c3-be41-9f2675ddfb71,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69bf73bbee1444febc675e813fd9af0c',protocol=,remote_address_group_id=,remote_group_id=871583be-00b2-479a-9441-ff11209d6b9b,remote_ip_prefix=,revision_number=0,security_group_id=871583be-00b2-479a-9441-ff11209d6b9b,updated_at=2022-10-09T00:57:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:10.188895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d4a1a899-98b8-49c3-be41-9f2675ddfb71), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.190116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-867d867b-3a2a-425b-b0dd-bb1afd040b29 admin admin] Security group rule updated ['871583be-00b2-479a-9441-ff11209d6b9b'] Oct 09 00:57:10.378469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Resource SecurityGroup deleted: 871583be-00b2-479a-9441-ff11209d6b9b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:10.379026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (871583be-00b2-479a-9441-ff11209d6b9b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.379665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('871583be-00b2-479a-9441-ff11209d6b9b',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:10.397843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('871583be-00b2-479a-9441-ff11209d6b9b',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:10.398562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Resource SecurityGroupRule deleted: a31450a2-6bb6-473c-b171-603dadb292ed {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:10.399211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a31450a2-6bb6-473c-b171-603dadb292ed), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.399774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Security group rule updated ['871583be-00b2-479a-9441-ff11209d6b9b'] Oct 09 00:57:10.400351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Resource SecurityGroupRule deleted: a8be2a19-b872-49e5-8df0-aee6b4da62b1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:10.400878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a8be2a19-b872-49e5-8df0-aee6b4da62b1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.401375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Security group rule updated ['871583be-00b2-479a-9441-ff11209d6b9b'] Oct 09 00:57:10.401907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Resource SecurityGroupRule deleted: d0d907e6-3cbd-4b24-b42f-2f75b901435a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:10.402430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d0d907e6-3cbd-4b24-b42f-2f75b901435a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.402913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Security group rule updated ['871583be-00b2-479a-9441-ff11209d6b9b'] Oct 09 00:57:10.403442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Resource SecurityGroupRule deleted: d4a1a899-98b8-49c3-be41-9f2675ddfb71 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:10.403963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d4a1a899-98b8-49c3-be41-9f2675ddfb71), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:10.404445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c44b8f0-07dd-46e7-a07e-72c6830b8c0a admin admin] Security group rule updated ['871583be-00b2-479a-9441-ff11209d6b9b'] Oct 09 00:57:10.642771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:278 started Oct 09 00:57:10.646745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=967000000,duration_sec=572,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:10.647889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:10.648716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:278 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:57:12.644827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:279 started Oct 09 00:57:12.648135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=968000000,duration_sec=574,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:12.648700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:12.649425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:279 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:13.133164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:12Z,description='Default security group',id=7e43be6b-75d3-4a5e-9f34-3feea1c5180f,is_default=True,name='default',project_id='88ea5df9d105498d896615626269e56a',revision_number=1,rules=[SecurityGroupRule(5504a899-513c-45f7-8898-fa68922b0e46),SecurityGroupRule(6d80bcd4-3e29-4d67-bf95-a884fa515c69),SecurityGroupRule(75e4ec4d-b90d-403d-b43d-f693bcd2bcfe),SecurityGroupRule(93540cd5-05ae-4f7c-a26f-7409758605c1)],shared=False,stateful=True,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.134144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (7e43be6b-75d3-4a5e-9f34-3feea1c5180f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.134890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:12Z,description=,direction='ingress',ethertype='IPv4',id=5504a899-513c-45f7-8898-fa68922b0e46,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88ea5df9d105498d896615626269e56a',protocol=,remote_address_group_id=,remote_group_id=7e43be6b-75d3-4a5e-9f34-3feea1c5180f,remote_ip_prefix=,revision_number=0,security_group_id=7e43be6b-75d3-4a5e-9f34-3feea1c5180f,updated_at=2022-10-09T00:57:12Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.135145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5504a899-513c-45f7-8898-fa68922b0e46), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.135481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Security group rule updated ['7e43be6b-75d3-4a5e-9f34-3feea1c5180f'] Oct 09 00:57:13.136184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='egress',ethertype='IPv6',id=6d80bcd4-3e29-4d67-bf95-a884fa515c69,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88ea5df9d105498d896615626269e56a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7e43be6b-75d3-4a5e-9f34-3feea1c5180f,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.136674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6d80bcd4-3e29-4d67-bf95-a884fa515c69), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.137007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Security group rule updated ['7e43be6b-75d3-4a5e-9f34-3feea1c5180f'] Oct 09 00:57:13.137692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='egress',ethertype='IPv4',id=75e4ec4d-b90d-403d-b43d-f693bcd2bcfe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88ea5df9d105498d896615626269e56a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7e43be6b-75d3-4a5e-9f34-3feea1c5180f,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.138405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (75e4ec4d-b90d-403d-b43d-f693bcd2bcfe), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.138405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Security group rule updated ['7e43be6b-75d3-4a5e-9f34-3feea1c5180f'] Oct 09 00:57:13.139007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='ingress',ethertype='IPv6',id=93540cd5-05ae-4f7c-a26f-7409758605c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88ea5df9d105498d896615626269e56a',protocol=,remote_address_group_id=,remote_group_id=7e43be6b-75d3-4a5e-9f34-3feea1c5180f,remote_ip_prefix=,revision_number=0,security_group_id=7e43be6b-75d3-4a5e-9f34-3feea1c5180f,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.139357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (93540cd5-05ae-4f7c-a26f-7409758605c1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.139724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-90e60d60-7933-4769-ace2-133946cbfba4 admin admin] Security group rule updated ['7e43be6b-75d3-4a5e-9f34-3feea1c5180f'] Oct 09 00:57:13.297398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Resource SecurityGroup deleted: 7e43be6b-75d3-4a5e-9f34-3feea1c5180f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:13.297775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (7e43be6b-75d3-4a5e-9f34-3feea1c5180f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.298224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7e43be6b-75d3-4a5e-9f34-3feea1c5180f',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:13.311834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7e43be6b-75d3-4a5e-9f34-3feea1c5180f',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:13.312549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Resource SecurityGroupRule deleted: 5504a899-513c-45f7-8898-fa68922b0e46 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:13.312925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5504a899-513c-45f7-8898-fa68922b0e46), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.313258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Security group rule updated ['7e43be6b-75d3-4a5e-9f34-3feea1c5180f'] Oct 09 00:57:13.313646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Resource SecurityGroupRule deleted: 6d80bcd4-3e29-4d67-bf95-a884fa515c69 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:13.313988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6d80bcd4-3e29-4d67-bf95-a884fa515c69), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.314310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Security group rule updated ['7e43be6b-75d3-4a5e-9f34-3feea1c5180f'] Oct 09 00:57:13.314703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Resource SecurityGroupRule deleted: 75e4ec4d-b90d-403d-b43d-f693bcd2bcfe {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:13.315250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (75e4ec4d-b90d-403d-b43d-f693bcd2bcfe), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.315579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Security group rule updated ['7e43be6b-75d3-4a5e-9f34-3feea1c5180f'] Oct 09 00:57:13.315968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Resource SecurityGroupRule deleted: 93540cd5-05ae-4f7c-a26f-7409758605c1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:13.316308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (93540cd5-05ae-4f7c-a26f-7409758605c1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.316621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3d4e24d8-6abd-43b8-a769-eef5941fe092 admin admin] Security group rule updated ['7e43be6b-75d3-4a5e-9f34-3feea1c5180f'] Oct 09 00:57:13.897198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:13Z,description='Default security group',id=0081edc8-6c2c-4a66-8894-94b7a2c6f833,is_default=True,name='default',project_id='9f95152a78a1496ca4266c3255a3e533',revision_number=1,rules=[SecurityGroupRule(208ad65c-d5c5-4fca-b07c-f2940716b89e),SecurityGroupRule(414e8a3c-2b35-4d68-adcc-d200513fe895),SecurityGroupRule(7d7c474a-f900-4905-bf12-867ab685447c),SecurityGroupRule(8d5f0e4d-7980-49bf-bbe3-e4513c50195e)],shared=False,stateful=True,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.898551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (0081edc8-6c2c-4a66-8894-94b7a2c6f833), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.900510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='egress',ethertype='IPv4',id=208ad65c-d5c5-4fca-b07c-f2940716b89e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9f95152a78a1496ca4266c3255a3e533',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0081edc8-6c2c-4a66-8894-94b7a2c6f833,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.901031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (208ad65c-d5c5-4fca-b07c-f2940716b89e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.901686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Security group rule updated ['0081edc8-6c2c-4a66-8894-94b7a2c6f833'] Oct 09 00:57:13.902685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='egress',ethertype='IPv6',id=414e8a3c-2b35-4d68-adcc-d200513fe895,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9f95152a78a1496ca4266c3255a3e533',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0081edc8-6c2c-4a66-8894-94b7a2c6f833,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.903452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (414e8a3c-2b35-4d68-adcc-d200513fe895), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.903998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Security group rule updated ['0081edc8-6c2c-4a66-8894-94b7a2c6f833'] Oct 09 00:57:13.904855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='ingress',ethertype='IPv6',id=7d7c474a-f900-4905-bf12-867ab685447c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9f95152a78a1496ca4266c3255a3e533',protocol=,remote_address_group_id=,remote_group_id=0081edc8-6c2c-4a66-8894-94b7a2c6f833,remote_ip_prefix=,revision_number=0,security_group_id=0081edc8-6c2c-4a66-8894-94b7a2c6f833,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.906684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7d7c474a-f900-4905-bf12-867ab685447c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.907172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Security group rule updated ['0081edc8-6c2c-4a66-8894-94b7a2c6f833'] Oct 09 00:57:13.910486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='ingress',ethertype='IPv4',id=8d5f0e4d-7980-49bf-bbe3-e4513c50195e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9f95152a78a1496ca4266c3255a3e533',protocol=,remote_address_group_id=,remote_group_id=0081edc8-6c2c-4a66-8894-94b7a2c6f833,remote_ip_prefix=,revision_number=0,security_group_id=0081edc8-6c2c-4a66-8894-94b7a2c6f833,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.911471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8d5f0e4d-7980-49bf-bbe3-e4513c50195e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.912406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-18b845e0-8d2e-47e8-9cc7-bbba1cddf5a5 admin admin] Security group rule updated ['0081edc8-6c2c-4a66-8894-94b7a2c6f833'] Oct 09 00:57:13.998104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:13Z,description='Default security group',id=a26189d0-0e50-4fd9-b327-da620a60a245,is_default=True,name='default',project_id='fb856bc06ad849b1b275840b69eb18a4',revision_number=1,rules=[SecurityGroupRule(a874a876-2706-4a20-a878-be790b79c719),SecurityGroupRule(d930ea70-c931-46e6-b10c-f6601e6b6abd),SecurityGroupRule(de94afd3-73ab-494c-afba-3036a7d08f7a),SecurityGroupRule(f2f3e091-e702-4e7a-a3fc-5769ef5cbba0)],shared=False,stateful=True,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.998482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (a26189d0-0e50-4fd9-b327-da620a60a245), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.999096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='ingress',ethertype='IPv6',id=a874a876-2706-4a20-a878-be790b79c719,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb856bc06ad849b1b275840b69eb18a4',protocol=,remote_address_group_id=,remote_group_id=a26189d0-0e50-4fd9-b327-da620a60a245,remote_ip_prefix=,revision_number=0,security_group_id=a26189d0-0e50-4fd9-b327-da620a60a245,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:13.999444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a874a876-2706-4a20-a878-be790b79c719), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:13.999802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Security group rule updated ['a26189d0-0e50-4fd9-b327-da620a60a245'] Oct 09 00:57:14.000465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='ingress',ethertype='IPv4',id=d930ea70-c931-46e6-b10c-f6601e6b6abd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb856bc06ad849b1b275840b69eb18a4',protocol=,remote_address_group_id=,remote_group_id=a26189d0-0e50-4fd9-b327-da620a60a245,remote_ip_prefix=,revision_number=0,security_group_id=a26189d0-0e50-4fd9-b327-da620a60a245,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:14.000811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d930ea70-c931-46e6-b10c-f6601e6b6abd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.001129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Security group rule updated ['a26189d0-0e50-4fd9-b327-da620a60a245'] Oct 09 00:57:14.001761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='egress',ethertype='IPv4',id=de94afd3-73ab-494c-afba-3036a7d08f7a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb856bc06ad849b1b275840b69eb18a4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a26189d0-0e50-4fd9-b327-da620a60a245,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:14.002107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (de94afd3-73ab-494c-afba-3036a7d08f7a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.002417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Security group rule updated ['a26189d0-0e50-4fd9-b327-da620a60a245'] Oct 09 00:57:14.003232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:13Z,description=,direction='egress',ethertype='IPv6',id=f2f3e091-e702-4e7a-a3fc-5769ef5cbba0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb856bc06ad849b1b275840b69eb18a4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a26189d0-0e50-4fd9-b327-da620a60a245,updated_at=2022-10-09T00:57:13Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:14.008376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f2f3e091-e702-4e7a-a3fc-5769ef5cbba0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.008955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a2921860-5c4d-47c8-bd7f-515400b78c4d admin admin] Security group rule updated ['a26189d0-0e50-4fd9-b327-da620a60a245'] Oct 09 00:57:14.094139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Resource SecurityGroup deleted: 0081edc8-6c2c-4a66-8894-94b7a2c6f833 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.094510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (0081edc8-6c2c-4a66-8894-94b7a2c6f833), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.095234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0081edc8-6c2c-4a66-8894-94b7a2c6f833',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:14.113314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0081edc8-6c2c-4a66-8894-94b7a2c6f833',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:14.113769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Resource SecurityGroupRule deleted: 208ad65c-d5c5-4fca-b07c-f2940716b89e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.114124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (208ad65c-d5c5-4fca-b07c-f2940716b89e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.114448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Security group rule updated ['0081edc8-6c2c-4a66-8894-94b7a2c6f833'] Oct 09 00:57:14.114836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Resource SecurityGroupRule deleted: 414e8a3c-2b35-4d68-adcc-d200513fe895 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.115172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (414e8a3c-2b35-4d68-adcc-d200513fe895), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.115496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Security group rule updated ['0081edc8-6c2c-4a66-8894-94b7a2c6f833'] Oct 09 00:57:14.115898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Resource SecurityGroupRule deleted: 7d7c474a-f900-4905-bf12-867ab685447c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.117009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7d7c474a-f900-4905-bf12-867ab685447c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.117322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Security group rule updated ['0081edc8-6c2c-4a66-8894-94b7a2c6f833'] Oct 09 00:57:14.117697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Resource SecurityGroupRule deleted: 8d5f0e4d-7980-49bf-bbe3-e4513c50195e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.118021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8d5f0e4d-7980-49bf-bbe3-e4513c50195e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.118328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f7cdc2d8-e6f9-4aff-9dae-82b96ae81550 admin admin] Security group rule updated ['0081edc8-6c2c-4a66-8894-94b7a2c6f833'] Oct 09 00:57:14.196527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Resource SecurityGroup deleted: a26189d0-0e50-4fd9-b327-da620a60a245 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.197102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (a26189d0-0e50-4fd9-b327-da620a60a245), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.197699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a26189d0-0e50-4fd9-b327-da620a60a245',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:14.212049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a26189d0-0e50-4fd9-b327-da620a60a245',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:14.213003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Resource SecurityGroupRule deleted: a874a876-2706-4a20-a878-be790b79c719 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.213629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a874a876-2706-4a20-a878-be790b79c719), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.214315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Security group rule updated ['a26189d0-0e50-4fd9-b327-da620a60a245'] Oct 09 00:57:14.214714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Resource SecurityGroupRule deleted: d930ea70-c931-46e6-b10c-f6601e6b6abd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.215056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d930ea70-c931-46e6-b10c-f6601e6b6abd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.215362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Security group rule updated ['a26189d0-0e50-4fd9-b327-da620a60a245'] Oct 09 00:57:14.215759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Resource SecurityGroupRule deleted: de94afd3-73ab-494c-afba-3036a7d08f7a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.216097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (de94afd3-73ab-494c-afba-3036a7d08f7a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.216411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Security group rule updated ['a26189d0-0e50-4fd9-b327-da620a60a245'] Oct 09 00:57:14.216826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Resource SecurityGroupRule deleted: f2f3e091-e702-4e7a-a3fc-5769ef5cbba0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:14.217272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f2f3e091-e702-4e7a-a3fc-5769ef5cbba0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:14.217741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-48f05bb5-d253-4f35-acd4-2d22a9543c6c admin admin] Security group rule updated ['a26189d0-0e50-4fd9-b327-da620a60a245'] Oct 09 00:57:14.646127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:280 started Oct 09 00:57:14.648736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=970000000,duration_sec=576,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:14.649308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:14.649662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:280 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:15.036084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:14Z,description='Default security group',id=9e56427f-83a8-4f89-8c52-45707b23c1bd,is_default=True,name='default',project_id='30f25c4e8f0046cfac8a8398ffa075e3',revision_number=1,rules=[SecurityGroupRule(3493f6ae-d8f5-4073-91e4-75f753b9bfbf),SecurityGroupRule(69a0bb0c-db12-45d8-9671-280342d6d2e8),SecurityGroupRule(7738197c-2e6f-4482-8350-8920bd7f1fb4),SecurityGroupRule(8a953a5f-5744-4e93-bd34-23fb7f40cca0)],shared=False,stateful=True,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.036690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (9e56427f-83a8-4f89-8c52-45707b23c1bd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.037213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:14Z,description=,direction='ingress',ethertype='IPv4',id=3493f6ae-d8f5-4073-91e4-75f753b9bfbf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30f25c4e8f0046cfac8a8398ffa075e3',protocol=,remote_address_group_id=,remote_group_id=9e56427f-83a8-4f89-8c52-45707b23c1bd,remote_ip_prefix=,revision_number=0,security_group_id=9e56427f-83a8-4f89-8c52-45707b23c1bd,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.037571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3493f6ae-d8f5-4073-91e4-75f753b9bfbf), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.038045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Security group rule updated ['9e56427f-83a8-4f89-8c52-45707b23c1bd'] Oct 09 00:57:15.038749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:14Z,description=,direction='egress',ethertype='IPv6',id=69a0bb0c-db12-45d8-9671-280342d6d2e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30f25c4e8f0046cfac8a8398ffa075e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e56427f-83a8-4f89-8c52-45707b23c1bd,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.039106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (69a0bb0c-db12-45d8-9671-280342d6d2e8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.039432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Security group rule updated ['9e56427f-83a8-4f89-8c52-45707b23c1bd'] Oct 09 00:57:15.040137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:14Z,description=,direction='ingress',ethertype='IPv6',id=7738197c-2e6f-4482-8350-8920bd7f1fb4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30f25c4e8f0046cfac8a8398ffa075e3',protocol=,remote_address_group_id=,remote_group_id=9e56427f-83a8-4f89-8c52-45707b23c1bd,remote_ip_prefix=,revision_number=0,security_group_id=9e56427f-83a8-4f89-8c52-45707b23c1bd,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.041977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7738197c-2e6f-4482-8350-8920bd7f1fb4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.042317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Security group rule updated ['9e56427f-83a8-4f89-8c52-45707b23c1bd'] Oct 09 00:57:15.042999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:14Z,description=,direction='egress',ethertype='IPv4',id=8a953a5f-5744-4e93-bd34-23fb7f40cca0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30f25c4e8f0046cfac8a8398ffa075e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e56427f-83a8-4f89-8c52-45707b23c1bd,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.043356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8a953a5f-5744-4e93-bd34-23fb7f40cca0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.043718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7d6e27ea-b435-47fb-9b0b-438a254946bc admin admin] Security group rule updated ['9e56427f-83a8-4f89-8c52-45707b23c1bd'] Oct 09 00:57:15.097274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:14Z,description='Default security group',id=32fc33a6-e82c-4d11-913d-83843cb04f56,is_default=True,name='default',project_id='619223fd7bd04d9e9d9f1a866bd1e2aa',revision_number=1,rules=[SecurityGroupRule(4581ab0a-fd1f-4465-abe0-61dfb2d78912),SecurityGroupRule(4977fef7-97d4-466b-a793-b0c493cfc0bb),SecurityGroupRule(7f273a26-ef72-4add-91a2-0945aa03c260),SecurityGroupRule(bf78774c-52a7-4623-bb67-099e18374f0e)],shared=False,stateful=True,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.097926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (32fc33a6-e82c-4d11-913d-83843cb04f56), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.098800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:14Z,description=,direction='ingress',ethertype='IPv4',id=4581ab0a-fd1f-4465-abe0-61dfb2d78912,normalized_cidr=None,port_range_max=,port_range_min=,project_id='619223fd7bd04d9e9d9f1a866bd1e2aa',protocol=,remote_address_group_id=,remote_group_id=32fc33a6-e82c-4d11-913d-83843cb04f56,remote_ip_prefix=,revision_number=0,security_group_id=32fc33a6-e82c-4d11-913d-83843cb04f56,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.099223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4581ab0a-fd1f-4465-abe0-61dfb2d78912), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.099705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Security group rule updated ['32fc33a6-e82c-4d11-913d-83843cb04f56'] Oct 09 00:57:15.100568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:14Z,description=,direction='egress',ethertype='IPv4',id=4977fef7-97d4-466b-a793-b0c493cfc0bb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='619223fd7bd04d9e9d9f1a866bd1e2aa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=32fc33a6-e82c-4d11-913d-83843cb04f56,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.101667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4977fef7-97d4-466b-a793-b0c493cfc0bb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.102187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Security group rule updated ['32fc33a6-e82c-4d11-913d-83843cb04f56'] Oct 09 00:57:15.103038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:14Z,description=,direction='egress',ethertype='IPv6',id=7f273a26-ef72-4add-91a2-0945aa03c260,normalized_cidr=None,port_range_max=,port_range_min=,project_id='619223fd7bd04d9e9d9f1a866bd1e2aa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=32fc33a6-e82c-4d11-913d-83843cb04f56,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.104023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7f273a26-ef72-4add-91a2-0945aa03c260), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.104438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Security group rule updated ['32fc33a6-e82c-4d11-913d-83843cb04f56'] Oct 09 00:57:15.105828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:14Z,description=,direction='ingress',ethertype='IPv6',id=bf78774c-52a7-4623-bb67-099e18374f0e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='619223fd7bd04d9e9d9f1a866bd1e2aa',protocol=,remote_address_group_id=,remote_group_id=32fc33a6-e82c-4d11-913d-83843cb04f56,remote_ip_prefix=,revision_number=0,security_group_id=32fc33a6-e82c-4d11-913d-83843cb04f56,updated_at=2022-10-09T00:57:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.106649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (bf78774c-52a7-4623-bb67-099e18374f0e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.107382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0a265108-b652-4688-be22-e95dcbe0f9b5 admin admin] Security group rule updated ['32fc33a6-e82c-4d11-913d-83843cb04f56'] Oct 09 00:57:15.194045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Resource SecurityGroup deleted: 9e56427f-83a8-4f89-8c52-45707b23c1bd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.194563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (9e56427f-83a8-4f89-8c52-45707b23c1bd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.195125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9e56427f-83a8-4f89-8c52-45707b23c1bd',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:15.212118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9e56427f-83a8-4f89-8c52-45707b23c1bd',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:15.213254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Resource SecurityGroupRule deleted: 3493f6ae-d8f5-4073-91e4-75f753b9bfbf {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.213692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3493f6ae-d8f5-4073-91e4-75f753b9bfbf), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.214093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Security group rule updated ['9e56427f-83a8-4f89-8c52-45707b23c1bd'] Oct 09 00:57:15.214545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Resource SecurityGroupRule deleted: 69a0bb0c-db12-45d8-9671-280342d6d2e8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.215228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (69a0bb0c-db12-45d8-9671-280342d6d2e8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.215697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Security group rule updated ['9e56427f-83a8-4f89-8c52-45707b23c1bd'] Oct 09 00:57:15.217608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Resource SecurityGroupRule deleted: 7738197c-2e6f-4482-8350-8920bd7f1fb4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.218553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7738197c-2e6f-4482-8350-8920bd7f1fb4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.219140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Security group rule updated ['9e56427f-83a8-4f89-8c52-45707b23c1bd'] Oct 09 00:57:15.219579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Resource SecurityGroupRule deleted: 8a953a5f-5744-4e93-bd34-23fb7f40cca0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.220131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8a953a5f-5744-4e93-bd34-23fb7f40cca0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.220556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6a07b279-4866-41d9-ba2f-688dd5568252 admin admin] Security group rule updated ['9e56427f-83a8-4f89-8c52-45707b23c1bd'] Oct 09 00:57:15.228236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Resource SecurityGroup deleted: 32fc33a6-e82c-4d11-913d-83843cb04f56 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.228833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (32fc33a6-e82c-4d11-913d-83843cb04f56), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.229373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('32fc33a6-e82c-4d11-913d-83843cb04f56',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:15.243209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('32fc33a6-e82c-4d11-913d-83843cb04f56',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:15.243698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Resource SecurityGroupRule deleted: 4581ab0a-fd1f-4465-abe0-61dfb2d78912 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.244200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4581ab0a-fd1f-4465-abe0-61dfb2d78912), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.244573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Security group rule updated ['32fc33a6-e82c-4d11-913d-83843cb04f56'] Oct 09 00:57:15.244975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Resource SecurityGroupRule deleted: 4977fef7-97d4-466b-a793-b0c493cfc0bb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.245322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4977fef7-97d4-466b-a793-b0c493cfc0bb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.245642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Security group rule updated ['32fc33a6-e82c-4d11-913d-83843cb04f56'] Oct 09 00:57:15.246014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Resource SecurityGroupRule deleted: 7f273a26-ef72-4add-91a2-0945aa03c260 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.246357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7f273a26-ef72-4add-91a2-0945aa03c260), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.246673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Security group rule updated ['32fc33a6-e82c-4d11-913d-83843cb04f56'] Oct 09 00:57:15.247251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Resource SecurityGroupRule deleted: bf78774c-52a7-4623-bb67-099e18374f0e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.247720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (bf78774c-52a7-4623-bb67-099e18374f0e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.248112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b5ffcb39-5a7a-464e-920c-018ca30c2284 admin admin] Security group rule updated ['32fc33a6-e82c-4d11-913d-83843cb04f56'] Oct 09 00:57:15.809782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:15Z,description='Default security group',id=dfe1797a-0e68-4f60-b5e5-b009a4b42c8a,is_default=True,name='default',project_id='dcc60c20223e4b8892d82f207177f9cc',revision_number=1,rules=[SecurityGroupRule(68f0fef9-2b4b-4f13-8221-a71ccc0497ee),SecurityGroupRule(6c0e5fb8-1ea0-400e-9d82-e78d09fffcf0),SecurityGroupRule(8b951a1d-6c0a-4574-9496-ae39c51a7f18),SecurityGroupRule(e846af8e-7dbc-47cc-8f35-ead6c1469f2c)],shared=False,stateful=True,updated_at=2022-10-09T00:57:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.810387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (dfe1797a-0e68-4f60-b5e5-b009a4b42c8a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.811390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:15Z,description=,direction='ingress',ethertype='IPv6',id=68f0fef9-2b4b-4f13-8221-a71ccc0497ee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dcc60c20223e4b8892d82f207177f9cc',protocol=,remote_address_group_id=,remote_group_id=dfe1797a-0e68-4f60-b5e5-b009a4b42c8a,remote_ip_prefix=,revision_number=0,security_group_id=dfe1797a-0e68-4f60-b5e5-b009a4b42c8a,updated_at=2022-10-09T00:57:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.812496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (68f0fef9-2b4b-4f13-8221-a71ccc0497ee), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.813026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Security group rule updated ['dfe1797a-0e68-4f60-b5e5-b009a4b42c8a'] Oct 09 00:57:15.813954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:15Z,description=,direction='ingress',ethertype='IPv4',id=6c0e5fb8-1ea0-400e-9d82-e78d09fffcf0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dcc60c20223e4b8892d82f207177f9cc',protocol=,remote_address_group_id=,remote_group_id=dfe1797a-0e68-4f60-b5e5-b009a4b42c8a,remote_ip_prefix=,revision_number=0,security_group_id=dfe1797a-0e68-4f60-b5e5-b009a4b42c8a,updated_at=2022-10-09T00:57:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.814891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6c0e5fb8-1ea0-400e-9d82-e78d09fffcf0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.815970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Security group rule updated ['dfe1797a-0e68-4f60-b5e5-b009a4b42c8a'] Oct 09 00:57:15.816815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:15Z,description=,direction='egress',ethertype='IPv4',id=8b951a1d-6c0a-4574-9496-ae39c51a7f18,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dcc60c20223e4b8892d82f207177f9cc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dfe1797a-0e68-4f60-b5e5-b009a4b42c8a,updated_at=2022-10-09T00:57:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.819790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8b951a1d-6c0a-4574-9496-ae39c51a7f18), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.820326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Security group rule updated ['dfe1797a-0e68-4f60-b5e5-b009a4b42c8a'] Oct 09 00:57:15.821193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:15Z,description=,direction='egress',ethertype='IPv6',id=e846af8e-7dbc-47cc-8f35-ead6c1469f2c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dcc60c20223e4b8892d82f207177f9cc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dfe1797a-0e68-4f60-b5e5-b009a4b42c8a,updated_at=2022-10-09T00:57:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:15.822765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e846af8e-7dbc-47cc-8f35-ead6c1469f2c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.823982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4f0ffae8-09b7-4d33-b3d4-92ca20e96696 admin admin] Security group rule updated ['dfe1797a-0e68-4f60-b5e5-b009a4b42c8a'] Oct 09 00:57:15.974925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Resource SecurityGroup deleted: dfe1797a-0e68-4f60-b5e5-b009a4b42c8a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.975585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (dfe1797a-0e68-4f60-b5e5-b009a4b42c8a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.976290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dfe1797a-0e68-4f60-b5e5-b009a4b42c8a',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:15.997418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dfe1797a-0e68-4f60-b5e5-b009a4b42c8a',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:15.998234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Resource SecurityGroupRule deleted: 68f0fef9-2b4b-4f13-8221-a71ccc0497ee {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:15.999199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (68f0fef9-2b4b-4f13-8221-a71ccc0497ee), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:15.999754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Security group rule updated ['dfe1797a-0e68-4f60-b5e5-b009a4b42c8a'] Oct 09 00:57:16.001353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Resource SecurityGroupRule deleted: 6c0e5fb8-1ea0-400e-9d82-e78d09fffcf0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:16.002343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6c0e5fb8-1ea0-400e-9d82-e78d09fffcf0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.003012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Security group rule updated ['dfe1797a-0e68-4f60-b5e5-b009a4b42c8a'] Oct 09 00:57:16.003793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Resource SecurityGroupRule deleted: 8b951a1d-6c0a-4574-9496-ae39c51a7f18 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:16.015815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8b951a1d-6c0a-4574-9496-ae39c51a7f18), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.015815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Security group rule updated ['dfe1797a-0e68-4f60-b5e5-b009a4b42c8a'] Oct 09 00:57:16.015815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Resource SecurityGroupRule deleted: e846af8e-7dbc-47cc-8f35-ead6c1469f2c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:16.015815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e846af8e-7dbc-47cc-8f35-ead6c1469f2c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.015815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1e8e5ad-f409-462b-a626-f0a1f1e74443 admin admin] Security group rule updated ['dfe1797a-0e68-4f60-b5e5-b009a4b42c8a'] Oct 09 00:57:16.450027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:16Z,description='Default security group',id=e6921ea3-4d95-453e-8a68-1508848829ee,is_default=True,name='default',project_id='aad4ea28111941a19ea89bf076cc9100',revision_number=1,rules=[SecurityGroupRule(2aecff0c-f2f5-4f7c-88fb-def9592727a0),SecurityGroupRule(7b208ffd-92e2-41af-b37a-87cd67e72cf2),SecurityGroupRule(c4cfe6c6-5ad6-4f96-88ea-d5de71a24608),SecurityGroupRule(fd298529-cc2f-435d-a32a-63bb97e17caa)],shared=False,stateful=True,updated_at=2022-10-09T00:57:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:16.450659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (e6921ea3-4d95-453e-8a68-1508848829ee), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.451042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:16Z,description=,direction='egress',ethertype='IPv6',id=2aecff0c-f2f5-4f7c-88fb-def9592727a0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aad4ea28111941a19ea89bf076cc9100',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e6921ea3-4d95-453e-8a68-1508848829ee,updated_at=2022-10-09T00:57:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:16.451406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2aecff0c-f2f5-4f7c-88fb-def9592727a0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.451921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Security group rule updated ['e6921ea3-4d95-453e-8a68-1508848829ee'] Oct 09 00:57:16.452923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:16Z,description=,direction='egress',ethertype='IPv4',id=7b208ffd-92e2-41af-b37a-87cd67e72cf2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aad4ea28111941a19ea89bf076cc9100',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e6921ea3-4d95-453e-8a68-1508848829ee,updated_at=2022-10-09T00:57:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:16.453635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7b208ffd-92e2-41af-b37a-87cd67e72cf2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.454280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Security group rule updated ['e6921ea3-4d95-453e-8a68-1508848829ee'] Oct 09 00:57:16.454939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:16Z,description=,direction='ingress',ethertype='IPv6',id=c4cfe6c6-5ad6-4f96-88ea-d5de71a24608,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aad4ea28111941a19ea89bf076cc9100',protocol=,remote_address_group_id=,remote_group_id=e6921ea3-4d95-453e-8a68-1508848829ee,remote_ip_prefix=,revision_number=0,security_group_id=e6921ea3-4d95-453e-8a68-1508848829ee,updated_at=2022-10-09T00:57:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:16.455421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c4cfe6c6-5ad6-4f96-88ea-d5de71a24608), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.456333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Security group rule updated ['e6921ea3-4d95-453e-8a68-1508848829ee'] Oct 09 00:57:16.458201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:16Z,description=,direction='ingress',ethertype='IPv4',id=fd298529-cc2f-435d-a32a-63bb97e17caa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aad4ea28111941a19ea89bf076cc9100',protocol=,remote_address_group_id=,remote_group_id=e6921ea3-4d95-453e-8a68-1508848829ee,remote_ip_prefix=,revision_number=0,security_group_id=e6921ea3-4d95-453e-8a68-1508848829ee,updated_at=2022-10-09T00:57:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:16.460245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fd298529-cc2f-435d-a32a-63bb97e17caa), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.461178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fb9d10df-0ceb-4b6e-8f3f-7092e90130a1 admin admin] Security group rule updated ['e6921ea3-4d95-453e-8a68-1508848829ee'] Oct 09 00:57:16.647344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:281 started Oct 09 00:57:16.649757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=971000000,duration_sec=578,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:16.650364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:16.650688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:281 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:57:16.655211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Resource SecurityGroup deleted: e6921ea3-4d95-453e-8a68-1508848829ee {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:16.655456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (e6921ea3-4d95-453e-8a68-1508848829ee), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.656525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e6921ea3-4d95-453e-8a68-1508848829ee',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:16.673748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e6921ea3-4d95-453e-8a68-1508848829ee',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:16.674395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Resource SecurityGroupRule deleted: 2aecff0c-f2f5-4f7c-88fb-def9592727a0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:16.675367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2aecff0c-f2f5-4f7c-88fb-def9592727a0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.675721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Security group rule updated ['e6921ea3-4d95-453e-8a68-1508848829ee'] Oct 09 00:57:16.676110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Resource SecurityGroupRule deleted: 7b208ffd-92e2-41af-b37a-87cd67e72cf2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:16.676450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7b208ffd-92e2-41af-b37a-87cd67e72cf2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.676763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Security group rule updated ['e6921ea3-4d95-453e-8a68-1508848829ee'] Oct 09 00:57:16.677125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Resource SecurityGroupRule deleted: c4cfe6c6-5ad6-4f96-88ea-d5de71a24608 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:16.677458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c4cfe6c6-5ad6-4f96-88ea-d5de71a24608), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.677775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Security group rule updated ['e6921ea3-4d95-453e-8a68-1508848829ee'] Oct 09 00:57:16.678187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Resource SecurityGroupRule deleted: fd298529-cc2f-435d-a32a-63bb97e17caa {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:16.678526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fd298529-cc2f-435d-a32a-63bb97e17caa), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:16.678836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fd526e24-d260-45db-9901-fedbe27a69e1 admin admin] Security group rule updated ['e6921ea3-4d95-453e-8a68-1508848829ee'] Oct 09 00:57:18.647915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:282 started Oct 09 00:57:18.650415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=971000000,duration_sec=580,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:18.651054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:18.651466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:282 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:18.735293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:18Z,description='Default security group',id=bab703b8-8c9e-489f-891e-212250499f75,is_default=True,name='default',project_id='b827c14124484ee58548c6f686a007f8',revision_number=1,rules=[SecurityGroupRule(32cd3ef6-9d05-4af3-ad24-5055370ce2e1),SecurityGroupRule(47d75ee1-3645-40c1-a02d-8272c58e3ecd),SecurityGroupRule(a6a50518-6a50-469c-b7da-eec65f566bc8),SecurityGroupRule(eb50886a-4591-4c3c-b11f-534bd7823475)],shared=False,stateful=True,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.735723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (bab703b8-8c9e-489f-891e-212250499f75), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.736913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:18Z,description=,direction='ingress',ethertype='IPv4',id=32cd3ef6-9d05-4af3-ad24-5055370ce2e1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b827c14124484ee58548c6f686a007f8',protocol=,remote_address_group_id=,remote_group_id=bab703b8-8c9e-489f-891e-212250499f75,remote_ip_prefix=,revision_number=0,security_group_id=bab703b8-8c9e-489f-891e-212250499f75,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.738130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (32cd3ef6-9d05-4af3-ad24-5055370ce2e1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.738519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Security group rule updated ['bab703b8-8c9e-489f-891e-212250499f75'] Oct 09 00:57:18.739214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:18Z,description=,direction='ingress',ethertype='IPv6',id=47d75ee1-3645-40c1-a02d-8272c58e3ecd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b827c14124484ee58548c6f686a007f8',protocol=,remote_address_group_id=,remote_group_id=bab703b8-8c9e-489f-891e-212250499f75,remote_ip_prefix=,revision_number=0,security_group_id=bab703b8-8c9e-489f-891e-212250499f75,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.739586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (47d75ee1-3645-40c1-a02d-8272c58e3ecd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.739925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Security group rule updated ['bab703b8-8c9e-489f-891e-212250499f75'] Oct 09 00:57:18.740591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:18Z,description=,direction='egress',ethertype='IPv6',id=a6a50518-6a50-469c-b7da-eec65f566bc8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b827c14124484ee58548c6f686a007f8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bab703b8-8c9e-489f-891e-212250499f75,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.740947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a6a50518-6a50-469c-b7da-eec65f566bc8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.741271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Security group rule updated ['bab703b8-8c9e-489f-891e-212250499f75'] Oct 09 00:57:18.742268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:18Z,description=,direction='egress',ethertype='IPv4',id=eb50886a-4591-4c3c-b11f-534bd7823475,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b827c14124484ee58548c6f686a007f8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bab703b8-8c9e-489f-891e-212250499f75,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.742858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (eb50886a-4591-4c3c-b11f-534bd7823475), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.743190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11c22d8b-7a31-4bd2-a48e-b8cd48245550 admin admin] Security group rule updated ['bab703b8-8c9e-489f-891e-212250499f75'] Oct 09 00:57:18.801460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:18Z,description='Default security group',id=ce0c2bb8-12b1-43e4-96c7-92c409904ea4,is_default=True,name='default',project_id='aaf669b496984e38b2d5621c650ab60d',revision_number=1,rules=[SecurityGroupRule(1d549bcc-a381-4762-b90e-9baf6a9e9bf3),SecurityGroupRule(647f3f30-340a-4e71-89b9-47e28de797d1),SecurityGroupRule(b5911712-936d-4bb3-a601-44dac3daa5ab),SecurityGroupRule(eb703426-4812-47c5-a5a4-90152bac8a8a)],shared=False,stateful=True,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.801913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (ce0c2bb8-12b1-43e4-96c7-92c409904ea4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.802673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:18Z,description=,direction='egress',ethertype='IPv6',id=1d549bcc-a381-4762-b90e-9baf6a9e9bf3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aaf669b496984e38b2d5621c650ab60d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ce0c2bb8-12b1-43e4-96c7-92c409904ea4,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.803089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1d549bcc-a381-4762-b90e-9baf6a9e9bf3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.803428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Security group rule updated ['ce0c2bb8-12b1-43e4-96c7-92c409904ea4'] Oct 09 00:57:18.804343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:18Z,description=,direction='ingress',ethertype='IPv6',id=647f3f30-340a-4e71-89b9-47e28de797d1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aaf669b496984e38b2d5621c650ab60d',protocol=,remote_address_group_id=,remote_group_id=ce0c2bb8-12b1-43e4-96c7-92c409904ea4,remote_ip_prefix=,revision_number=0,security_group_id=ce0c2bb8-12b1-43e4-96c7-92c409904ea4,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.804702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (647f3f30-340a-4e71-89b9-47e28de797d1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.805083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Security group rule updated ['ce0c2bb8-12b1-43e4-96c7-92c409904ea4'] Oct 09 00:57:18.805742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:18Z,description=,direction='egress',ethertype='IPv4',id=b5911712-936d-4bb3-a601-44dac3daa5ab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aaf669b496984e38b2d5621c650ab60d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ce0c2bb8-12b1-43e4-96c7-92c409904ea4,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.806124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b5911712-936d-4bb3-a601-44dac3daa5ab), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.806456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Security group rule updated ['ce0c2bb8-12b1-43e4-96c7-92c409904ea4'] Oct 09 00:57:18.807115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:18Z,description=,direction='ingress',ethertype='IPv4',id=eb703426-4812-47c5-a5a4-90152bac8a8a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aaf669b496984e38b2d5621c650ab60d',protocol=,remote_address_group_id=,remote_group_id=ce0c2bb8-12b1-43e4-96c7-92c409904ea4,remote_ip_prefix=,revision_number=0,security_group_id=ce0c2bb8-12b1-43e4-96c7-92c409904ea4,updated_at=2022-10-09T00:57:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:18.807786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (eb703426-4812-47c5-a5a4-90152bac8a8a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.807786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c412e33-d74f-4ffe-a7d8-8457d84225ab admin admin] Security group rule updated ['ce0c2bb8-12b1-43e4-96c7-92c409904ea4'] Oct 09 00:57:18.981629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-90e9532c-e53a-4677-add6-a42bf56a7bd7 tempest-DeleteServersTestJSON-718467185 tempest-DeleteServersTestJSON-718467185-project] Resource Port deleted: afb80013-2258-4db2-b056-f0c814dfdeed {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:18.983096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-90e9532c-e53a-4677-add6-a42bf56a7bd7 tempest-DeleteServersTestJSON-718467185 tempest-DeleteServersTestJSON-718467185-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (afb80013-2258-4db2-b056-f0c814dfdeed), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.983999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-90e9532c-e53a-4677-add6-a42bf56a7bd7 tempest-DeleteServersTestJSON-718467185 tempest-DeleteServersTestJSON-718467185-project] Security group member updated {'5ca2704a-36a6-44be-843b-b3c729b1a9d0'} Oct 09 00:57:18.989995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Resource SecurityGroup deleted: bab703b8-8c9e-489f-891e-212250499f75 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:18.991090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (bab703b8-8c9e-489f-891e-212250499f75), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.991931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bab703b8-8c9e-489f-891e-212250499f75',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:18.995883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Resource SecurityGroup deleted: ce0c2bb8-12b1-43e4-96c7-92c409904ea4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:18.997088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (ce0c2bb8-12b1-43e4-96c7-92c409904ea4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:18.998134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ce0c2bb8-12b1-43e4-96c7-92c409904ea4',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:19.013437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bab703b8-8c9e-489f-891e-212250499f75',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:19.016202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Resource SecurityGroupRule deleted: 32cd3ef6-9d05-4af3-ad24-5055370ce2e1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.016805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (32cd3ef6-9d05-4af3-ad24-5055370ce2e1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.017549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Security group rule updated ['bab703b8-8c9e-489f-891e-212250499f75'] Oct 09 00:57:19.018147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Resource SecurityGroupRule deleted: 47d75ee1-3645-40c1-a02d-8272c58e3ecd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.019350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (47d75ee1-3645-40c1-a02d-8272c58e3ecd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.019925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Security group rule updated ['bab703b8-8c9e-489f-891e-212250499f75'] Oct 09 00:57:19.020498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Resource SecurityGroupRule deleted: a6a50518-6a50-469c-b7da-eec65f566bc8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.021106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a6a50518-6a50-469c-b7da-eec65f566bc8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.021627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Security group rule updated ['bab703b8-8c9e-489f-891e-212250499f75'] Oct 09 00:57:19.022193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Resource SecurityGroupRule deleted: eb50886a-4591-4c3c-b11f-534bd7823475 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.022978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (eb50886a-4591-4c3c-b11f-534bd7823475), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.023676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6cd4c16f-3299-47b5-b542-2b332a011f05 admin admin] Security group rule updated ['bab703b8-8c9e-489f-891e-212250499f75'] Oct 09 00:57:19.039542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ce0c2bb8-12b1-43e4-96c7-92c409904ea4',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:19.040179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Resource SecurityGroupRule deleted: 1d549bcc-a381-4762-b90e-9baf6a9e9bf3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.040774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1d549bcc-a381-4762-b90e-9baf6a9e9bf3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.041260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Security group rule updated ['ce0c2bb8-12b1-43e4-96c7-92c409904ea4'] Oct 09 00:57:19.041860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Resource SecurityGroupRule deleted: 647f3f30-340a-4e71-89b9-47e28de797d1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.042305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (647f3f30-340a-4e71-89b9-47e28de797d1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.042724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Security group rule updated ['ce0c2bb8-12b1-43e4-96c7-92c409904ea4'] Oct 09 00:57:19.043356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Resource SecurityGroupRule deleted: b5911712-936d-4bb3-a601-44dac3daa5ab {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.043846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b5911712-936d-4bb3-a601-44dac3daa5ab), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.044972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Security group rule updated ['ce0c2bb8-12b1-43e4-96c7-92c409904ea4'] Oct 09 00:57:19.048509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Resource SecurityGroupRule deleted: eb703426-4812-47c5-a5a4-90152bac8a8a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.048991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (eb703426-4812-47c5-a5a4-90152bac8a8a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.049416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1296084e-069d-430c-a4e6-8b663715dda1 admin admin] Security group rule updated ['ce0c2bb8-12b1-43e4-96c7-92c409904ea4'] Oct 09 00:57:19.645486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:19Z,description='Default security group',id=2439465c-be9c-4665-ba46-d6572933338d,is_default=True,name='default',project_id='93fd69ab23c54fb08cff7e8d89e7adbf',revision_number=1,rules=[SecurityGroupRule(3a6cea2e-21a1-4b6f-9d64-a3ca3a15b5ed),SecurityGroupRule(6b984b2f-508a-40db-9a76-c58536445fb9),SecurityGroupRule(e4ac8c66-7ad7-43f4-ac7f-cba4892846d3),SecurityGroupRule(e815db62-5dfb-4edc-9935-7162f0d8e534)],shared=False,stateful=True,updated_at=2022-10-09T00:57:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:19.645922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (2439465c-be9c-4665-ba46-d6572933338d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.646559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:19Z,description=,direction='ingress',ethertype='IPv6',id=3a6cea2e-21a1-4b6f-9d64-a3ca3a15b5ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='93fd69ab23c54fb08cff7e8d89e7adbf',protocol=,remote_address_group_id=,remote_group_id=2439465c-be9c-4665-ba46-d6572933338d,remote_ip_prefix=,revision_number=0,security_group_id=2439465c-be9c-4665-ba46-d6572933338d,updated_at=2022-10-09T00:57:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:19.646918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3a6cea2e-21a1-4b6f-9d64-a3ca3a15b5ed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.647252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Security group rule updated ['2439465c-be9c-4665-ba46-d6572933338d'] Oct 09 00:57:19.648097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:19Z,description=,direction='egress',ethertype='IPv6',id=6b984b2f-508a-40db-9a76-c58536445fb9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='93fd69ab23c54fb08cff7e8d89e7adbf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2439465c-be9c-4665-ba46-d6572933338d,updated_at=2022-10-09T00:57:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:19.648657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6b984b2f-508a-40db-9a76-c58536445fb9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.648908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Security group rule updated ['2439465c-be9c-4665-ba46-d6572933338d'] Oct 09 00:57:19.649717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:19Z,description=,direction='ingress',ethertype='IPv4',id=e4ac8c66-7ad7-43f4-ac7f-cba4892846d3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='93fd69ab23c54fb08cff7e8d89e7adbf',protocol=,remote_address_group_id=,remote_group_id=2439465c-be9c-4665-ba46-d6572933338d,remote_ip_prefix=,revision_number=0,security_group_id=2439465c-be9c-4665-ba46-d6572933338d,updated_at=2022-10-09T00:57:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:19.650216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e4ac8c66-7ad7-43f4-ac7f-cba4892846d3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.650571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Security group rule updated ['2439465c-be9c-4665-ba46-d6572933338d'] Oct 09 00:57:19.651209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:19Z,description=,direction='egress',ethertype='IPv4',id=e815db62-5dfb-4edc-9935-7162f0d8e534,normalized_cidr=None,port_range_max=,port_range_min=,project_id='93fd69ab23c54fb08cff7e8d89e7adbf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2439465c-be9c-4665-ba46-d6572933338d,updated_at=2022-10-09T00:57:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:19.651561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e815db62-5dfb-4edc-9935-7162f0d8e534), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.654124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-88291be0-ffa4-41c2-96a6-53545c5b9539 admin admin] Security group rule updated ['2439465c-be9c-4665-ba46-d6572933338d'] Oct 09 00:57:19.816931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Resource SecurityGroup deleted: 2439465c-be9c-4665-ba46-d6572933338d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.817482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (2439465c-be9c-4665-ba46-d6572933338d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.818118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2439465c-be9c-4665-ba46-d6572933338d',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:19.833996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2439465c-be9c-4665-ba46-d6572933338d',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:19.834742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Resource SecurityGroupRule deleted: 3a6cea2e-21a1-4b6f-9d64-a3ca3a15b5ed {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.835347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3a6cea2e-21a1-4b6f-9d64-a3ca3a15b5ed), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.836035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Security group rule updated ['2439465c-be9c-4665-ba46-d6572933338d'] Oct 09 00:57:19.836600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Resource SecurityGroupRule deleted: 6b984b2f-508a-40db-9a76-c58536445fb9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.837001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6b984b2f-508a-40db-9a76-c58536445fb9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.837599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Security group rule updated ['2439465c-be9c-4665-ba46-d6572933338d'] Oct 09 00:57:19.838182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Resource SecurityGroupRule deleted: e4ac8c66-7ad7-43f4-ac7f-cba4892846d3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.838676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e4ac8c66-7ad7-43f4-ac7f-cba4892846d3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.839190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Security group rule updated ['2439465c-be9c-4665-ba46-d6572933338d'] Oct 09 00:57:19.839735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Resource SecurityGroupRule deleted: e815db62-5dfb-4edc-9935-7162f0d8e534 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:19.840249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e815db62-5dfb-4edc-9935-7162f0d8e534), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:19.840770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-49fa1002-c64f-43ae-8d66-3dc4b238ad6c admin admin] Security group rule updated ['2439465c-be9c-4665-ba46-d6572933338d'] Oct 09 00:57:20.350838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:20Z,description='Default security group',id=ea9c2385-9da9-4a2a-8fb6-e8e646bdf411,is_default=True,name='default',project_id='ea6cd31ea35842bd9e36c7a3b66a1fb3',revision_number=1,rules=[SecurityGroupRule(6205dd2c-4463-47ca-9bc4-de72bba4c795),SecurityGroupRule(b6b2ee1f-4254-4282-b8da-cbfc50347450),SecurityGroupRule(f632df29-21de-4a91-99c8-1b1dd3b2b0a1),SecurityGroupRule(fef5127b-88ad-4059-820a-ca269196460b)],shared=False,stateful=True,updated_at=2022-10-09T00:57:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:20.351219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (ea9c2385-9da9-4a2a-8fb6-e8e646bdf411), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.351937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:20Z,description=,direction='ingress',ethertype='IPv4',id=6205dd2c-4463-47ca-9bc4-de72bba4c795,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea6cd31ea35842bd9e36c7a3b66a1fb3',protocol=,remote_address_group_id=,remote_group_id=ea9c2385-9da9-4a2a-8fb6-e8e646bdf411,remote_ip_prefix=,revision_number=0,security_group_id=ea9c2385-9da9-4a2a-8fb6-e8e646bdf411,updated_at=2022-10-09T00:57:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:20.352348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6205dd2c-4463-47ca-9bc4-de72bba4c795), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.352689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Security group rule updated ['ea9c2385-9da9-4a2a-8fb6-e8e646bdf411'] Oct 09 00:57:20.353365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:20Z,description=,direction='ingress',ethertype='IPv6',id=b6b2ee1f-4254-4282-b8da-cbfc50347450,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea6cd31ea35842bd9e36c7a3b66a1fb3',protocol=,remote_address_group_id=,remote_group_id=ea9c2385-9da9-4a2a-8fb6-e8e646bdf411,remote_ip_prefix=,revision_number=0,security_group_id=ea9c2385-9da9-4a2a-8fb6-e8e646bdf411,updated_at=2022-10-09T00:57:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:20.353815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b6b2ee1f-4254-4282-b8da-cbfc50347450), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.354147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Security group rule updated ['ea9c2385-9da9-4a2a-8fb6-e8e646bdf411'] Oct 09 00:57:20.354798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:20Z,description=,direction='egress',ethertype='IPv4',id=f632df29-21de-4a91-99c8-1b1dd3b2b0a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea6cd31ea35842bd9e36c7a3b66a1fb3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ea9c2385-9da9-4a2a-8fb6-e8e646bdf411,updated_at=2022-10-09T00:57:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:20.355149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f632df29-21de-4a91-99c8-1b1dd3b2b0a1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.355504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Security group rule updated ['ea9c2385-9da9-4a2a-8fb6-e8e646bdf411'] Oct 09 00:57:20.356180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:20Z,description=,direction='egress',ethertype='IPv6',id=fef5127b-88ad-4059-820a-ca269196460b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea6cd31ea35842bd9e36c7a3b66a1fb3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ea9c2385-9da9-4a2a-8fb6-e8e646bdf411,updated_at=2022-10-09T00:57:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:20.356528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fef5127b-88ad-4059-820a-ca269196460b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.356853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2ad0a0b2-6c45-416f-a71b-79941009aba7 admin admin] Security group rule updated ['ea9c2385-9da9-4a2a-8fb6-e8e646bdf411'] Oct 09 00:57:20.512522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Resource SecurityGroup deleted: ea9c2385-9da9-4a2a-8fb6-e8e646bdf411 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:20.513039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (ea9c2385-9da9-4a2a-8fb6-e8e646bdf411), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.513925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ea9c2385-9da9-4a2a-8fb6-e8e646bdf411',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:20.528122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ea9c2385-9da9-4a2a-8fb6-e8e646bdf411',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:20.528762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Resource SecurityGroupRule deleted: 6205dd2c-4463-47ca-9bc4-de72bba4c795 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:20.529334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6205dd2c-4463-47ca-9bc4-de72bba4c795), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.529669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Security group rule updated ['ea9c2385-9da9-4a2a-8fb6-e8e646bdf411'] Oct 09 00:57:20.530062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Resource SecurityGroupRule deleted: b6b2ee1f-4254-4282-b8da-cbfc50347450 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:20.530404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b6b2ee1f-4254-4282-b8da-cbfc50347450), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.530720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Security group rule updated ['ea9c2385-9da9-4a2a-8fb6-e8e646bdf411'] Oct 09 00:57:20.531084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Resource SecurityGroupRule deleted: f632df29-21de-4a91-99c8-1b1dd3b2b0a1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:20.531713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f632df29-21de-4a91-99c8-1b1dd3b2b0a1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.532023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Security group rule updated ['ea9c2385-9da9-4a2a-8fb6-e8e646bdf411'] Oct 09 00:57:20.532535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Resource SecurityGroupRule deleted: fef5127b-88ad-4059-820a-ca269196460b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:20.532866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fef5127b-88ad-4059-820a-ca269196460b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.533332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b38ec9bd-937f-4e7d-ad07-783051deb47f admin admin] Security group rule updated ['ea9c2385-9da9-4a2a-8fb6-e8e646bdf411'] Oct 09 00:57:20.649223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:283 started Oct 09 00:57:20.652134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=973000000,duration_sec=582,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:20.652791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:20.653133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:283 - starting polling. Elapsed:0.004 Oct 09 00:57:20.656275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:20.658245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port afb80013-2258-4db2-b056-f0c814dfdeed not present in bridge br-int Oct 09 00:57:20.658973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 00:57:20.659438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['afb80013-2258-4db2-b056-f0c814dfdeed'] Oct 09 00:57:20.659807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port afb80013-2258-4db2-b056-f0c814dfdeed is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 00:57:20.662770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:283 - port information retrieved. Elapsed:0.014 Oct 09 00:57:20.663109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:283 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 09 00:57:22.649967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:284 started Oct 09 00:57:22.652392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=973000000,duration_sec=584,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:22.652958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:22.653314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:284 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:24.651373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:285 started Oct 09 00:57:24.654066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=975000000,duration_sec=586,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:24.654634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:24.654992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:285 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:26.652625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:286 started Oct 09 00:57:26.654935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=976000000,duration_sec=588,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:26.655493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:26.655885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:286 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:57:28.653637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:287 started Oct 09 00:57:28.657911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=978000000,duration_sec=590,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:28.658763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:28.659320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:287 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:57:28.730879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:28Z,description='Default security group',id=98dd9bd6-198a-48da-b00d-b0116146b77e,is_default=True,name='default',project_id='91d97c3bee2d48ecac465ead2ab9b24a',revision_number=1,rules=[SecurityGroupRule(320d4275-3c66-4c99-ae0a-1af3085243ae),SecurityGroupRule(5169638d-533f-4d13-985e-a87b28f2884e),SecurityGroupRule(ad9f468d-eefc-49ff-aa35-892218e05061),SecurityGroupRule(ef904f59-2d1d-4cc7-9f88-9027378a9eb9)],shared=False,stateful=True,updated_at=2022-10-09T00:57:28Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:28.731384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (98dd9bd6-198a-48da-b00d-b0116146b77e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:28.732038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:28Z,description=,direction='ingress',ethertype='IPv4',id=320d4275-3c66-4c99-ae0a-1af3085243ae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91d97c3bee2d48ecac465ead2ab9b24a',protocol=,remote_address_group_id=,remote_group_id=98dd9bd6-198a-48da-b00d-b0116146b77e,remote_ip_prefix=,revision_number=0,security_group_id=98dd9bd6-198a-48da-b00d-b0116146b77e,updated_at=2022-10-09T00:57:28Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:28.732398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (320d4275-3c66-4c99-ae0a-1af3085243ae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:28.732732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Security group rule updated ['98dd9bd6-198a-48da-b00d-b0116146b77e'] Oct 09 00:57:28.733818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:28Z,description=,direction='egress',ethertype='IPv4',id=5169638d-533f-4d13-985e-a87b28f2884e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91d97c3bee2d48ecac465ead2ab9b24a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=98dd9bd6-198a-48da-b00d-b0116146b77e,updated_at=2022-10-09T00:57:28Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:28.734397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5169638d-533f-4d13-985e-a87b28f2884e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:28.734934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Security group rule updated ['98dd9bd6-198a-48da-b00d-b0116146b77e'] Oct 09 00:57:28.735705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:28Z,description=,direction='ingress',ethertype='IPv6',id=ad9f468d-eefc-49ff-aa35-892218e05061,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91d97c3bee2d48ecac465ead2ab9b24a',protocol=,remote_address_group_id=,remote_group_id=98dd9bd6-198a-48da-b00d-b0116146b77e,remote_ip_prefix=,revision_number=0,security_group_id=98dd9bd6-198a-48da-b00d-b0116146b77e,updated_at=2022-10-09T00:57:28Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:28.736120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ad9f468d-eefc-49ff-aa35-892218e05061), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:28.736514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Security group rule updated ['98dd9bd6-198a-48da-b00d-b0116146b77e'] Oct 09 00:57:28.737341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:28Z,description=,direction='egress',ethertype='IPv6',id=ef904f59-2d1d-4cc7-9f88-9027378a9eb9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91d97c3bee2d48ecac465ead2ab9b24a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=98dd9bd6-198a-48da-b00d-b0116146b77e,updated_at=2022-10-09T00:57:28Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:28.737768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ef904f59-2d1d-4cc7-9f88-9027378a9eb9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:28.738240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0d381ebf-383b-4178-b7f8-c6d419696e36 admin admin] Security group rule updated ['98dd9bd6-198a-48da-b00d-b0116146b77e'] Oct 09 00:57:29.042660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Resource SecurityGroup deleted: 98dd9bd6-198a-48da-b00d-b0116146b77e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:29.043062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (98dd9bd6-198a-48da-b00d-b0116146b77e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:29.043516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('98dd9bd6-198a-48da-b00d-b0116146b77e',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:29.057279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('98dd9bd6-198a-48da-b00d-b0116146b77e',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:29.057931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Resource SecurityGroupRule deleted: 320d4275-3c66-4c99-ae0a-1af3085243ae {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:29.058306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (320d4275-3c66-4c99-ae0a-1af3085243ae), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:29.058638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Security group rule updated ['98dd9bd6-198a-48da-b00d-b0116146b77e'] Oct 09 00:57:29.059025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Resource SecurityGroupRule deleted: 5169638d-533f-4d13-985e-a87b28f2884e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:29.059455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5169638d-533f-4d13-985e-a87b28f2884e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:29.059828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Security group rule updated ['98dd9bd6-198a-48da-b00d-b0116146b77e'] Oct 09 00:57:29.060201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Resource SecurityGroupRule deleted: ad9f468d-eefc-49ff-aa35-892218e05061 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:29.060936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ad9f468d-eefc-49ff-aa35-892218e05061), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:29.061310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Security group rule updated ['98dd9bd6-198a-48da-b00d-b0116146b77e'] Oct 09 00:57:29.061683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Resource SecurityGroupRule deleted: ef904f59-2d1d-4cc7-9f88-9027378a9eb9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:29.062023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ef904f59-2d1d-4cc7-9f88-9027378a9eb9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:29.062339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-61f067ae-2709-4794-9a37-c31e9491bea6 admin admin] Security group rule updated ['98dd9bd6-198a-48da-b00d-b0116146b77e'] Oct 09 00:57:29.098927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4857031b-da8b-4130-819b-de7d37d9d4db admin admin] Resource Port deleted: e219175f-338c-47ca-ba2c-40a73c82d3b3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:29.099495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4857031b-da8b-4130-819b-de7d37d9d4db admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (e219175f-338c-47ca-ba2c-40a73c82d3b3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.170513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0c5664fa-29d2-40d6-9ab3-d474199d0ccd","delete","qr-e219175f-33",12,["map",[["attached-mac","fa:16:3e:65:4f:bc"],["iface-id","e219175f-338c-47ca-ba2c-40a73c82d3b3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:30.263113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e9d10c45-c535-42ae-948d-452b4d323e49 admin admin] Resource Port deleted: 8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:30.263113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e9d10c45-c535-42ae-948d-452b4d323e49 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.432442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:30Z,description='Default security group',id=a5ea1b67-e696-4fb5-bc67-454cb680565a,is_default=True,name='default',project_id='ffd9810571304dcd9c69dbc1b8e89763',revision_number=1,rules=[SecurityGroupRule(5adf1a42-af1c-4124-a93d-35c5d8fb6b4b),SecurityGroupRule(5fe10c75-8504-48ca-814e-dc1c0d42f82a),SecurityGroupRule(6b0ca3d3-6e2e-4f8f-827c-feb72e5d5f88),SecurityGroupRule(b225300b-10b4-48d3-b3c0-e4c4e3a7e2c2)],shared=False,stateful=True,updated_at=2022-10-09T00:57:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:30.433077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (a5ea1b67-e696-4fb5-bc67-454cb680565a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.433984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:30Z,description=,direction='ingress',ethertype='IPv4',id=5adf1a42-af1c-4124-a93d-35c5d8fb6b4b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ffd9810571304dcd9c69dbc1b8e89763',protocol=,remote_address_group_id=,remote_group_id=a5ea1b67-e696-4fb5-bc67-454cb680565a,remote_ip_prefix=,revision_number=0,security_group_id=a5ea1b67-e696-4fb5-bc67-454cb680565a,updated_at=2022-10-09T00:57:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:30.434705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5adf1a42-af1c-4124-a93d-35c5d8fb6b4b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.435498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Security group rule updated ['a5ea1b67-e696-4fb5-bc67-454cb680565a'] Oct 09 00:57:30.436397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:30Z,description=,direction='ingress',ethertype='IPv6',id=5fe10c75-8504-48ca-814e-dc1c0d42f82a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ffd9810571304dcd9c69dbc1b8e89763',protocol=,remote_address_group_id=,remote_group_id=a5ea1b67-e696-4fb5-bc67-454cb680565a,remote_ip_prefix=,revision_number=0,security_group_id=a5ea1b67-e696-4fb5-bc67-454cb680565a,updated_at=2022-10-09T00:57:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:30.436934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5fe10c75-8504-48ca-814e-dc1c0d42f82a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.437433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Security group rule updated ['a5ea1b67-e696-4fb5-bc67-454cb680565a'] Oct 09 00:57:30.438284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:30Z,description=,direction='egress',ethertype='IPv4',id=6b0ca3d3-6e2e-4f8f-827c-feb72e5d5f88,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ffd9810571304dcd9c69dbc1b8e89763',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a5ea1b67-e696-4fb5-bc67-454cb680565a,updated_at=2022-10-09T00:57:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:30.438838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6b0ca3d3-6e2e-4f8f-827c-feb72e5d5f88), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.439336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Security group rule updated ['a5ea1b67-e696-4fb5-bc67-454cb680565a'] Oct 09 00:57:30.440185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:30Z,description=,direction='egress',ethertype='IPv6',id=b225300b-10b4-48d3-b3c0-e4c4e3a7e2c2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ffd9810571304dcd9c69dbc1b8e89763',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a5ea1b67-e696-4fb5-bc67-454cb680565a,updated_at=2022-10-09T00:57:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:30.440740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b225300b-10b4-48d3-b3c0-e4c4e3a7e2c2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.441249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29af76e8-7cd2-4fed-a54e-a9f1d3cf8c47 admin admin] Security group rule updated ['a5ea1b67-e696-4fb5-bc67-454cb680565a'] Oct 09 00:57:30.588411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0a5f9e9b-4f07-4e80-98a2-d900fa48e035","delete","qg-8f0d6bb2-ed",13,["map",[["attached-mac","fa:16:3e:92:0a:b8"],["iface-id","8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:30.655358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:288 started Oct 09 00:57:30.753918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Resource SecurityGroup deleted: a5ea1b67-e696-4fb5-bc67-454cb680565a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:30.754410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (a5ea1b67-e696-4fb5-bc67-454cb680565a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.754938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a5ea1b67-e696-4fb5-bc67-454cb680565a',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:30.770128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a5ea1b67-e696-4fb5-bc67-454cb680565a',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:30.770582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Resource SecurityGroupRule deleted: 5adf1a42-af1c-4124-a93d-35c5d8fb6b4b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:30.770948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5adf1a42-af1c-4124-a93d-35c5d8fb6b4b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.771277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Security group rule updated ['a5ea1b67-e696-4fb5-bc67-454cb680565a'] Oct 09 00:57:30.771713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Resource SecurityGroupRule deleted: 5fe10c75-8504-48ca-814e-dc1c0d42f82a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:30.772033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5fe10c75-8504-48ca-814e-dc1c0d42f82a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.772359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Security group rule updated ['a5ea1b67-e696-4fb5-bc67-454cb680565a'] Oct 09 00:57:30.772726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Resource SecurityGroupRule deleted: 6b0ca3d3-6e2e-4f8f-827c-feb72e5d5f88 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:30.773066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6b0ca3d3-6e2e-4f8f-827c-feb72e5d5f88), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.773383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Security group rule updated ['a5ea1b67-e696-4fb5-bc67-454cb680565a'] Oct 09 00:57:30.773744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Resource SecurityGroupRule deleted: b225300b-10b4-48d3-b3c0-e4c4e3a7e2c2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:30.774083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b225300b-10b4-48d3-b3c0-e4c4e3a7e2c2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.774396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-85f0e239-f594-44b5-905c-4365b9f34b4d admin admin] Security group rule updated ['a5ea1b67-e696-4fb5-bc67-454cb680565a'] Oct 09 00:57:30.811357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8d58b409-d13f-466a-913b-4ee0bd3d7df3 admin admin] Resource Subnet deleted: a548fa97-cb20-45d6-8da8-0556662605e1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:30.811846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8d58b409-d13f-466a-913b-4ee0bd3d7df3 admin admin] Publish callbacks [] for Subnet (a548fa97-cb20-45d6-8da8-0556662605e1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.899047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=209000000,duration_sec=593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:30.900244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:30.900706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:288 - starting polling. Elapsed:0.246 Oct 09 00:57:30.903064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:30.920609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee56,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:30.924386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee58,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:30.924702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:288 - port information retrieved. Elapsed:0.270 Oct 09 00:57:30.925036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', '4c7027d2-8e83-425b-bce4-3a2c26d6231c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': {'8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'e219175f-338c-47ca-ba2c-40a73c82d3b3'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:30.925566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:288 - agent port security group processed in 0.000 Oct 09 00:57:30.928057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 00:57:30.928511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'e219175f-338c-47ca-ba2c-40a73c82d3b3'} Oct 09 00:57:30.929148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 8 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:30.976298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0fb4e4ff-13ec-41fc-946a-a45c7a782db2","delete","tap4c7027d2-8e",7,["map",[["attached-mac","fa:16:3e:7d:32:64"],["iface-id","4c7027d2-8e83-425b-bce4-3a2c26d6231c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:31.006240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[a077e080-0ef3-4c5a-b858-4711f7b9d977]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:31.008210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'8f0d6bb2-ed95-422c-bfa4-4628c23cf5a5', 'e219175f-338c-47ca-ba2c-40a73c82d3b3'} removed Oct 09 00:57:31.099695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 00:57:31.100443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:288 - treat_devices_removed completed in 0.172 Oct 09 00:57:31.101076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:288 - ports processed. Elapsed:0.446 Oct 09 00:57:31.101521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:288 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.446 Oct 09 00:57:31.199743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d66b0614-e11d-4bcc-b084-e5baba7d4bfc admin admin] Resource Port deleted: 4c7027d2-8e83-425b-bce4-3a2c26d6231c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:31.200847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d66b0614-e11d-4bcc-b084-e5baba7d4bfc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (4c7027d2-8e83-425b-bce4-3a2c26d6231c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:31.458038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fe092d93-3bdc-4e9c-be06-7c0bd86b787a None None] Resource Port deleted: 4c7027d2-8e83-425b-bce4-3a2c26d6231c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:31.459273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fe092d93-3bdc-4e9c-be06-7c0bd86b787a None None] Skipped duplicate delete event for 4c7027d2-8e83-425b-bce4-3a2c26d6231c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 09 00:57:31.703343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d66b0614-e11d-4bcc-b084-e5baba7d4bfc admin admin] Resource Network deleted: bd0c3622-3100-4974-8f51-c7c8194d1e19 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:31.703929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d66b0614-e11d-4bcc-b084-e5baba7d4bfc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (bd0c3622-3100-4974-8f51-c7c8194d1e19), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.076650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:31Z,description='Default security group',id=efe8e641-d0f7-40f4-b7d8-d8c3916e70eb,is_default=True,name='default',project_id='28bc82345ea24b929b66fbcded2b97b7',revision_number=1,rules=[SecurityGroupRule(41a168ef-31b5-44fa-bcc8-1e3ff1f7133d),SecurityGroupRule(63f13082-bb6b-467f-bbaf-d79b7b4b835f),SecurityGroupRule(c435a9c8-9d33-4c7b-b43e-c1a4bf6ed1de),SecurityGroupRule(e3748a3d-f613-488a-a340-90f0a49dfc6f)],shared=False,stateful=True,updated_at=2022-10-09T00:57:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.077284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (efe8e641-d0f7-40f4-b7d8-d8c3916e70eb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.078139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:31Z,description=,direction='ingress',ethertype='IPv4',id=41a168ef-31b5-44fa-bcc8-1e3ff1f7133d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol=,remote_address_group_id=,remote_group_id=efe8e641-d0f7-40f4-b7d8-d8c3916e70eb,remote_ip_prefix=,revision_number=0,security_group_id=efe8e641-d0f7-40f4-b7d8-d8c3916e70eb,updated_at=2022-10-09T00:57:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.078672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (41a168ef-31b5-44fa-bcc8-1e3ff1f7133d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.079177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Security group rule updated ['efe8e641-d0f7-40f4-b7d8-d8c3916e70eb'] Oct 09 00:57:32.080116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:31Z,description=,direction='egress',ethertype='IPv6',id=63f13082-bb6b-467f-bbaf-d79b7b4b835f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=efe8e641-d0f7-40f4-b7d8-d8c3916e70eb,updated_at=2022-10-09T00:57:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.080637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (63f13082-bb6b-467f-bbaf-d79b7b4b835f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.081116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Security group rule updated ['efe8e641-d0f7-40f4-b7d8-d8c3916e70eb'] Oct 09 00:57:32.082614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:31Z,description=,direction='egress',ethertype='IPv4',id=c435a9c8-9d33-4c7b-b43e-c1a4bf6ed1de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=efe8e641-d0f7-40f4-b7d8-d8c3916e70eb,updated_at=2022-10-09T00:57:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.084045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c435a9c8-9d33-4c7b-b43e-c1a4bf6ed1de), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.084533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Security group rule updated ['efe8e641-d0f7-40f4-b7d8-d8c3916e70eb'] Oct 09 00:57:32.086364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:31Z,description=,direction='ingress',ethertype='IPv6',id=e3748a3d-f613-488a-a340-90f0a49dfc6f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol=,remote_address_group_id=,remote_group_id=efe8e641-d0f7-40f4-b7d8-d8c3916e70eb,remote_ip_prefix=,revision_number=0,security_group_id=efe8e641-d0f7-40f4-b7d8-d8c3916e70eb,updated_at=2022-10-09T00:57:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.088024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e3748a3d-f613-488a-a340-90f0a49dfc6f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.088532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Security group rule updated ['efe8e641-d0f7-40f4-b7d8-d8c3916e70eb'] Oct 09 00:57:32.258656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:57:31Z,description='',dns_domain=None,id=51f66c80-6e94-4ac9-ad00-6dd9246260d1,mtu=1500,name='tempest-TestVolumeBootPattern-1389518512-network',project_id='28bc82345ea24b929b66fbcded2b97b7',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(51f66c80-6e94-4ac9-ad00-6dd9246260d1),segments=[NetworkSegment(9512762e-780c-464c-a567-4995173eb1a6)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:57:32Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.259326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (51f66c80-6e94-4ac9-ad00-6dd9246260d1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-049050ea-c59a-4d42-9996-60b6328c89ff admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 51f66c80-6e94-4ac9-ad00-6dd9246260d1 with segmentation id not found. Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:57:32.407568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:57:32.408442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:57:32.408442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:57:32.408442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:57:32.408442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 51f66c80-6e94-4ac9-ad00-6dd9246260d1 with segmentation id not found. Oct 09 00:57:32.408442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:57:32.612018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3fc870a1-a128-4b8f-b1c3-bf1b5f837de0 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(328a7018-c033-4b56-8b1e-3077fd59df3d)],cidr=172.20.0.0/28,created_at=2022-10-09T00:57:32Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=d7f3cba3-1b89-4cb1-b9ef-80793ce54a94,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-1389518512-subnet',network_id=51f66c80-6e94-4ac9-ad00-6dd9246260d1,project_id='28bc82345ea24b929b66fbcded2b97b7',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:57:32Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.612481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3fc870a1-a128-4b8f-b1c3-bf1b5f837de0 admin admin] Publish callbacks [] for Subnet (d7f3cba3-1b89-4cb1-b9ef-80793ce54a94), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.656542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:289 started Oct 09 00:57:32.660240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=980000000,duration_sec=594,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:32.660961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:32.661439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:289 - starting polling. Elapsed:0.005 Oct 09 00:57:32.663546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.670303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee5c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:32.670810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:289 - port information retrieved. Elapsed:0.014 Oct 09 00:57:32.671054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': {'4c7027d2-8e83-425b-bce4-3a2c26d6231c'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:32.671275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:289 - agent port security group processed in 0.000 Oct 09 00:57:32.673338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 00:57:32.678551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'4c7027d2-8e83-425b-bce4-3a2c26d6231c'} Oct 09 00:57:32.678942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:32.757723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:32Z,description='Default security group',id=a2ad32e6-afd4-4692-bd09-7b1e131a1699,is_default=True,name='default',project_id='c15c3df3639a48dc9d1276290b1a0173',revision_number=1,rules=[SecurityGroupRule(64c40b49-2924-4c49-b3cc-0f3d2564ade2),SecurityGroupRule(740ed42b-b826-4710-ab9c-136567edc016),SecurityGroupRule(7737bebf-1eda-4287-9f60-c7254bef857f),SecurityGroupRule(7d21e157-90aa-4943-a6ab-d1564b588049)],shared=False,stateful=True,updated_at=2022-10-09T00:57:32Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.758740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (a2ad32e6-afd4-4692-bd09-7b1e131a1699), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.759530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:32Z,description=,direction='egress',ethertype='IPv4',id=64c40b49-2924-4c49-b3cc-0f3d2564ade2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c15c3df3639a48dc9d1276290b1a0173',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2ad32e6-afd4-4692-bd09-7b1e131a1699,updated_at=2022-10-09T00:57:32Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.760120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (64c40b49-2924-4c49-b3cc-0f3d2564ade2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.760972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Security group rule updated ['a2ad32e6-afd4-4692-bd09-7b1e131a1699'] Oct 09 00:57:32.761797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:32Z,description=,direction='egress',ethertype='IPv6',id=740ed42b-b826-4710-ab9c-136567edc016,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c15c3df3639a48dc9d1276290b1a0173',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2ad32e6-afd4-4692-bd09-7b1e131a1699,updated_at=2022-10-09T00:57:32Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.762486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (740ed42b-b826-4710-ab9c-136567edc016), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.762989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Security group rule updated ['a2ad32e6-afd4-4692-bd09-7b1e131a1699'] Oct 09 00:57:32.764140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:32Z,description=,direction='ingress',ethertype='IPv4',id=7737bebf-1eda-4287-9f60-c7254bef857f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c15c3df3639a48dc9d1276290b1a0173',protocol=,remote_address_group_id=,remote_group_id=a2ad32e6-afd4-4692-bd09-7b1e131a1699,remote_ip_prefix=,revision_number=0,security_group_id=a2ad32e6-afd4-4692-bd09-7b1e131a1699,updated_at=2022-10-09T00:57:32Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.764678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7737bebf-1eda-4287-9f60-c7254bef857f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.765152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Security group rule updated ['a2ad32e6-afd4-4692-bd09-7b1e131a1699'] Oct 09 00:57:32.767756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:32Z,description=,direction='ingress',ethertype='IPv6',id=7d21e157-90aa-4943-a6ab-d1564b588049,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c15c3df3639a48dc9d1276290b1a0173',protocol=,remote_address_group_id=,remote_group_id=a2ad32e6-afd4-4692-bd09-7b1e131a1699,remote_ip_prefix=,revision_number=0,security_group_id=a2ad32e6-afd4-4692-bd09-7b1e131a1699,updated_at=2022-10-09T00:57:32Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:32.769883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7d21e157-90aa-4943-a6ab-d1564b588049), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.771433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-21727235-fc0e-4f68-bcdf-594611267851 admin admin] Security group rule updated ['a2ad32e6-afd4-4692-bd09-7b1e131a1699'] Oct 09 00:57:32.777151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Resource SecurityGroup deleted: 5ca2704a-36a6-44be-843b-b3c729b1a9d0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:32.777528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (5ca2704a-36a6-44be-843b-b3c729b1a9d0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.778749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5ca2704a-36a6-44be-843b-b3c729b1a9d0',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:32.784383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceca2c1b-80c5-4549-acd8-cc3db667beba]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:32.793228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'4c7027d2-8e83-425b-bce4-3a2c26d6231c'} removed Oct 09 00:57:32.845069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 00:57:32.845923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 5 from net-id = bd0c3622-3100-4974-8f51-c7c8194d1e19, seg-id = 657 Oct 09 00:57:32.846991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5ca2704a-36a6-44be-843b-b3c729b1a9d0',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:32.847918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Resource SecurityGroupRule deleted: 220b85ae-c348-4ce7-91f2-7d9e3a8464eb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:32.848286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (220b85ae-c348-4ce7-91f2-7d9e3a8464eb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.848758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Security group rule updated ['5ca2704a-36a6-44be-843b-b3c729b1a9d0'] Oct 09 00:57:32.849303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Resource SecurityGroupRule deleted: 73d76d4a-d37c-4021-b136-5edabdbf9c6e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:32.849647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (73d76d4a-d37c-4021-b136-5edabdbf9c6e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.849966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Security group rule updated ['5ca2704a-36a6-44be-843b-b3c729b1a9d0'] Oct 09 00:57:32.850333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Resource SecurityGroupRule deleted: 7a6822e1-1f88-4c55-bfde-bcb9cab0674f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:32.850672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7a6822e1-1f88-4c55-bfde-bcb9cab0674f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.850984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Security group rule updated ['5ca2704a-36a6-44be-843b-b3c729b1a9d0'] Oct 09 00:57:32.851338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Resource SecurityGroupRule deleted: f186b8dd-6211-4f3f-8e1c-cb8a49bb29fd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:32.851894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f186b8dd-6211-4f3f-8e1c-cb8a49bb29fd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.853717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1e56ef5e-fad3-454a-9981-e6f2bc90d05e admin admin] Security group rule updated ['5ca2704a-36a6-44be-843b-b3c729b1a9d0'] Oct 09 00:57:32.866438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da182f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:32.873580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363ee5e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4753}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:32.874532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:289 - treat_devices_removed completed in 0.195 Oct 09 00:57:32.874532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:289 - ports processed. Elapsed:0.218 Oct 09 00:57:32.874743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:289 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.218 Oct 09 00:57:32.955844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Resource SecurityGroup deleted: a2ad32e6-afd4-4692-bd09-7b1e131a1699 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:32.956214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (a2ad32e6-afd4-4692-bd09-7b1e131a1699), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:32.956735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a2ad32e6-afd4-4692-bd09-7b1e131a1699',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:33.033785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a2ad32e6-afd4-4692-bd09-7b1e131a1699',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:33.035472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Resource SecurityGroupRule deleted: 64c40b49-2924-4c49-b3cc-0f3d2564ade2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:33.036869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (64c40b49-2924-4c49-b3cc-0f3d2564ade2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.037954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Security group rule updated ['a2ad32e6-afd4-4692-bd09-7b1e131a1699'] Oct 09 00:57:33.038927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Resource SecurityGroupRule deleted: 740ed42b-b826-4710-ab9c-136567edc016 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:33.039459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (740ed42b-b826-4710-ab9c-136567edc016), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.040585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Security group rule updated ['a2ad32e6-afd4-4692-bd09-7b1e131a1699'] Oct 09 00:57:33.041105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Resource SecurityGroupRule deleted: 7737bebf-1eda-4287-9f60-c7254bef857f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:33.041621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7737bebf-1eda-4287-9f60-c7254bef857f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.042070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Security group rule updated ['a2ad32e6-afd4-4692-bd09-7b1e131a1699'] Oct 09 00:57:33.042616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Resource SecurityGroupRule deleted: 7d21e157-90aa-4943-a6ab-d1564b588049 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:33.043091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7d21e157-90aa-4943-a6ab-d1564b588049), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.043567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-048e09c7-3095-4c3c-906d-a6cfad993385 admin admin] Security group rule updated ['a2ad32e6-afd4-4692-bd09-7b1e131a1699'] Oct 09 00:57:33.595179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-27724c0a-5a8f-4c5c-aeda-eeb1b9b336f2 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:57:32Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-51f66c80-6e94-4ac9-ad00-6dd9246260d1',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e117ae0c-3834-457d-833e-82227f33c129,mac_address=fa:16:3e:bc:0d:c2,name='',network_id=51f66c80-6e94-4ac9-ad00-6dd9246260d1,numa_affinity_policy=,project_id='28bc82345ea24b929b66fbcded2b97b7',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e117ae0c-3834-457d-833e-82227f33c129),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:57:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:33.595929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-27724c0a-5a8f-4c5c-aeda-eeb1b9b336f2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e117ae0c-3834-457d-833e-82227f33c129), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.741362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:33Z,description='Default security group',id=a8a15047-c03e-4b24-b3e2-0a24a203074f,is_default=True,name='default',project_id='b0adffcc6be142ee987cf24ca2c646b1',revision_number=1,rules=[SecurityGroupRule(50a550f1-e108-486a-903a-98d7f31a3051),SecurityGroupRule(9d9d6de3-506a-4e83-9fea-21084c3499e0),SecurityGroupRule(b9a3dfdb-f302-4df4-ab72-aab5ed8c3be7),SecurityGroupRule(f98946c6-9a5a-4818-99bc-2bacc3e25f6b)],shared=False,stateful=True,updated_at=2022-10-09T00:57:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:33.742626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (a8a15047-c03e-4b24-b3e2-0a24a203074f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.743789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:33Z,description=,direction='egress',ethertype='IPv6',id=50a550f1-e108-486a-903a-98d7f31a3051,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b0adffcc6be142ee987cf24ca2c646b1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a8a15047-c03e-4b24-b3e2-0a24a203074f,updated_at=2022-10-09T00:57:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:33.744376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (50a550f1-e108-486a-903a-98d7f31a3051), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.744907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Security group rule updated ['a8a15047-c03e-4b24-b3e2-0a24a203074f'] Oct 09 00:57:33.746610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:33Z,description=,direction='egress',ethertype='IPv4',id=9d9d6de3-506a-4e83-9fea-21084c3499e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b0adffcc6be142ee987cf24ca2c646b1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a8a15047-c03e-4b24-b3e2-0a24a203074f,updated_at=2022-10-09T00:57:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:33.747745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9d9d6de3-506a-4e83-9fea-21084c3499e0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.749436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Security group rule updated ['a8a15047-c03e-4b24-b3e2-0a24a203074f'] Oct 09 00:57:33.750426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:33Z,description=,direction='ingress',ethertype='IPv6',id=b9a3dfdb-f302-4df4-ab72-aab5ed8c3be7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b0adffcc6be142ee987cf24ca2c646b1',protocol=,remote_address_group_id=,remote_group_id=a8a15047-c03e-4b24-b3e2-0a24a203074f,remote_ip_prefix=,revision_number=0,security_group_id=a8a15047-c03e-4b24-b3e2-0a24a203074f,updated_at=2022-10-09T00:57:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:33.751079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b9a3dfdb-f302-4df4-ab72-aab5ed8c3be7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.752333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Security group rule updated ['a8a15047-c03e-4b24-b3e2-0a24a203074f'] Oct 09 00:57:33.755389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:33Z,description=,direction='ingress',ethertype='IPv4',id=f98946c6-9a5a-4818-99bc-2bacc3e25f6b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b0adffcc6be142ee987cf24ca2c646b1',protocol=,remote_address_group_id=,remote_group_id=a8a15047-c03e-4b24-b3e2-0a24a203074f,remote_ip_prefix=,revision_number=0,security_group_id=a8a15047-c03e-4b24-b3e2-0a24a203074f,updated_at=2022-10-09T00:57:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:33.756125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f98946c6-9a5a-4818-99bc-2bacc3e25f6b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:33.757793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-92f030f8-d90f-4130-949a-2829912e6d54 admin admin] Security group rule updated ['a8a15047-c03e-4b24-b3e2-0a24a203074f'] Oct 09 00:57:33.898318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-27724c0a-5a8f-4c5c-aeda-eeb1b9b336f2 None None] Resource Port e117ae0c-3834-457d-833e-82227f33c129 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e117ae0c-3834-457d-833e-82227f33c129,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e117ae0c-3834-457d-833e-82227f33c129,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e117ae0c-3834-457d-833e-82227f33c129,segment=NetworkSegment(9512762e-780c-464c-a567-4995173eb1a6),segment_id=9512762e-780c-464c-a567-4995173eb1a6)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:33.899282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-27724c0a-5a8f-4c5c-aeda-eeb1b9b336f2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e117ae0c-3834-457d-833e-82227f33c129), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.003191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Resource SecurityGroup deleted: a8a15047-c03e-4b24-b3e2-0a24a203074f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:34.003895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (a8a15047-c03e-4b24-b3e2-0a24a203074f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.004710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a8a15047-c03e-4b24-b3e2-0a24a203074f',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:34.042763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a8a15047-c03e-4b24-b3e2-0a24a203074f',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:34.043537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Resource SecurityGroupRule deleted: 50a550f1-e108-486a-903a-98d7f31a3051 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:34.043938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (50a550f1-e108-486a-903a-98d7f31a3051), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.044459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Security group rule updated ['a8a15047-c03e-4b24-b3e2-0a24a203074f'] Oct 09 00:57:34.044861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Resource SecurityGroupRule deleted: 9d9d6de3-506a-4e83-9fea-21084c3499e0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:34.045233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9d9d6de3-506a-4e83-9fea-21084c3499e0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.045554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Security group rule updated ['a8a15047-c03e-4b24-b3e2-0a24a203074f'] Oct 09 00:57:34.045935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Resource SecurityGroupRule deleted: b9a3dfdb-f302-4df4-ab72-aab5ed8c3be7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:34.046280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b9a3dfdb-f302-4df4-ab72-aab5ed8c3be7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.046747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Security group rule updated ['a8a15047-c03e-4b24-b3e2-0a24a203074f'] Oct 09 00:57:34.047558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Resource SecurityGroupRule deleted: f98946c6-9a5a-4818-99bc-2bacc3e25f6b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:34.048069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f98946c6-9a5a-4818-99bc-2bacc3e25f6b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.048536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7ba80a01-65f3-46d4-81c7-8fcd6300075f admin admin] Security group rule updated ['a8a15047-c03e-4b24-b3e2-0a24a203074f'] Oct 09 00:57:34.071172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aec66d75-098f-4180-9fa8-1cbe08f6c2af","insert","tape117ae0c-38",["set",[]],["map",[["attached-mac","fa:16:3e:bc:0d:c2"],["iface-id","e117ae0c-3834-457d-833e-82227f33c129"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:34.091798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aec66d75-098f-4180-9fa8-1cbe08f6c2af","old",null,["set",[]],null],["","new","tape117ae0c-38",18,["map",[["attached-mac","fa:16:3e:bc:0d:c2"],["iface-id","e117ae0c-3834-457d-833e-82227f33c129"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:34.479402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-586a565a-d372-4462-9828-fa98cce4c4bc admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:57:33Z,data_plane_status=None,description='',device_id='9d4c8a9c-2aee-4c52-9304-60a68ad85504',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fb7aab07-c773-45fb-ab7c-b325d1a9f4ef,mac_address=fa:16:3e:14:05:b1,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fb7aab07-c773-45fb-ab7c-b325d1a9f4ef),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:57:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:34.480792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-586a565a-d372-4462-9828-fa98cce4c4bc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (fb7aab07-c773-45fb-ab7c-b325d1a9f4ef), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.658163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:290 started Oct 09 00:57:34.665566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=982000000,duration_sec=596,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:34.666323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:34.666912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:290 - starting polling. Elapsed:0.009 Oct 09 00:57:34.671234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.680493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:290 - port information retrieved. Elapsed:0.023 Oct 09 00:57:34.682737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'e117ae0c-3834-457d-833e-82227f33c129'}, 'removed': set(), 'updated': {'e117ae0c-3834-457d-833e-82227f33c129'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:34.683501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'e117ae0c-3834-457d-833e-82227f33c129', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'network_id': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'port_id': 'e117ae0c-3834-457d-833e-82227f33c129', 'mac_address': 'fa:16:3e:bc:0d:c2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd7f3cba3-1b89-4cb1-b9ef-80793ce54a94', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:34.688710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e117ae0c-3834-457d-833e-82227f33c129 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:34.696184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e117ae0c-3834-457d-833e-82227f33c129 updated. Details: {'device': 'e117ae0c-3834-457d-833e-82227f33c129', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'network_id': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'port_id': 'e117ae0c-3834-457d-833e-82227f33c129', 'mac_address': 'fa:16:3e:bc:0d:c2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd7f3cba3-1b89-4cb1-b9ef-80793ce54a94', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:57:34.696184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 8 as local vlan for net-id=51f66c80-6e94-4ac9-ad00-6dd9246260d1, seg-id=681 Oct 09 00:57:34.701080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da1831,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4777), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:34.707742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363ee62,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4104)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4777}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:34.708812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tape117ae0c-38, col_values=(('tag', 8),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:34.711213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tape117ae0c-38, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:34.711681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tape117ae0c-38, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:34.725621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tape117ae0c-38, col_values=(('other_config', {'net_uuid': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '681'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:34.746748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee64,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:34.747328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:290 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.064 Oct 09 00:57:34.750164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:57:34.750546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'e117ae0c-3834-457d-833e-82227f33c129'} Oct 09 00:57:34.752801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:34.754634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:34.763689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:34.779566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:34Z,description='Default security group',id=1f64d3a4-4108-481e-a29c-19faa98a3dfe,is_default=True,name='default',project_id='0571ef472ec449f5bf821d4c27e43c90',revision_number=1,rules=[SecurityGroupRule(1220e97d-611b-4f71-bfed-a8c65ad4712d),SecurityGroupRule(80cd172e-e0bc-47a9-8647-b3244fc45fd4),SecurityGroupRule(b13d94ba-48f1-495d-b29b-abaa12a957f4),SecurityGroupRule(be03bc06-1d4c-4bf1-a740-23ef0f2e8032)],shared=False,stateful=True,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:34.780336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (1f64d3a4-4108-481e-a29c-19faa98a3dfe), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.781741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:34Z,description=,direction='ingress',ethertype='IPv4',id=1220e97d-611b-4f71-bfed-a8c65ad4712d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0571ef472ec449f5bf821d4c27e43c90',protocol=,remote_address_group_id=,remote_group_id=1f64d3a4-4108-481e-a29c-19faa98a3dfe,remote_ip_prefix=,revision_number=0,security_group_id=1f64d3a4-4108-481e-a29c-19faa98a3dfe,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:34.787672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1220e97d-611b-4f71-bfed-a8c65ad4712d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.788056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Security group rule updated ['1f64d3a4-4108-481e-a29c-19faa98a3dfe'] Oct 09 00:57:34.828971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[33040239-fa14-43db-9b95-7233abdc9d44]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:34.829691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:290 - agent port security group processed in 0.147 Oct 09 00:57:34.830489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for e117ae0c-3834-457d-833e-82227f33c129 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:34.837044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:34Z,description=,direction='egress',ethertype='IPv4',id=80cd172e-e0bc-47a9-8647-b3244fc45fd4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0571ef472ec449f5bf821d4c27e43c90',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1f64d3a4-4108-481e-a29c-19faa98a3dfe,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:34.837744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (80cd172e-e0bc-47a9-8647-b3244fc45fd4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.838425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Security group rule updated ['1f64d3a4-4108-481e-a29c-19faa98a3dfe'] Oct 09 00:57:34.840142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:34Z,description=,direction='egress',ethertype='IPv6',id=b13d94ba-48f1-495d-b29b-abaa12a957f4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0571ef472ec449f5bf821d4c27e43c90',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1f64d3a4-4108-481e-a29c-19faa98a3dfe,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:34.840987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b13d94ba-48f1-495d-b29b-abaa12a957f4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.842006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Security group rule updated ['1f64d3a4-4108-481e-a29c-19faa98a3dfe'] Oct 09 00:57:34.844579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:34Z,description=,direction='ingress',ethertype='IPv6',id=be03bc06-1d4c-4bf1-a740-23ef0f2e8032,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0571ef472ec449f5bf821d4c27e43c90',protocol=,remote_address_group_id=,remote_group_id=1f64d3a4-4108-481e-a29c-19faa98a3dfe,remote_ip_prefix=,revision_number=0,security_group_id=1f64d3a4-4108-481e-a29c-19faa98a3dfe,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:34.848334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (be03bc06-1d4c-4bf1-a740-23ef0f2e8032), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:34.849264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dce37c03-fcd5-4643-81ef-8fd5f1ecc976 admin admin] Security group rule updated ['1f64d3a4-4108-481e-a29c-19faa98a3dfe'] Oct 09 00:57:35.045643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:34Z,description='Default security group',id=2519351b-2b49-4620-bf60-e9a4a1810434,is_default=True,name='default',project_id='f5a5a1e0aa9d43fba6e79cb7d035241f',revision_number=1,rules=[SecurityGroupRule(1439e119-b29d-48c4-be76-6b1f57df90f5),SecurityGroupRule(4a7e1fbf-fe8a-47d7-a2e3-f3982feb4ab3),SecurityGroupRule(dc723890-0215-43f5-baf7-e80c17ffdf80),SecurityGroupRule(f839095b-f337-4d83-a319-f061d6c434c6)],shared=False,stateful=True,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:35.045993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (2519351b-2b49-4620-bf60-e9a4a1810434), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.046773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:34Z,description=,direction='egress',ethertype='IPv6',id=1439e119-b29d-48c4-be76-6b1f57df90f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5a5a1e0aa9d43fba6e79cb7d035241f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2519351b-2b49-4620-bf60-e9a4a1810434,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:35.047714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1439e119-b29d-48c4-be76-6b1f57df90f5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.048418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Security group rule updated ['2519351b-2b49-4620-bf60-e9a4a1810434'] Oct 09 00:57:35.049068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:34Z,description=,direction='ingress',ethertype='IPv4',id=4a7e1fbf-fe8a-47d7-a2e3-f3982feb4ab3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5a5a1e0aa9d43fba6e79cb7d035241f',protocol=,remote_address_group_id=,remote_group_id=2519351b-2b49-4620-bf60-e9a4a1810434,remote_ip_prefix=,revision_number=0,security_group_id=2519351b-2b49-4620-bf60-e9a4a1810434,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:35.049865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4a7e1fbf-fe8a-47d7-a2e3-f3982feb4ab3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.050232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Security group rule updated ['2519351b-2b49-4620-bf60-e9a4a1810434'] Oct 09 00:57:35.051540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:34Z,description=,direction='ingress',ethertype='IPv6',id=dc723890-0215-43f5-baf7-e80c17ffdf80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5a5a1e0aa9d43fba6e79cb7d035241f',protocol=,remote_address_group_id=,remote_group_id=2519351b-2b49-4620-bf60-e9a4a1810434,remote_ip_prefix=,revision_number=0,security_group_id=2519351b-2b49-4620-bf60-e9a4a1810434,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:35.051897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (dc723890-0215-43f5-baf7-e80c17ffdf80), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.053518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Security group rule updated ['2519351b-2b49-4620-bf60-e9a4a1810434'] Oct 09 00:57:35.054206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:34Z,description=,direction='egress',ethertype='IPv4',id=f839095b-f337-4d83-a319-f061d6c434c6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5a5a1e0aa9d43fba6e79cb7d035241f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2519351b-2b49-4620-bf60-e9a4a1810434,updated_at=2022-10-09T00:57:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:35.054893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f839095b-f337-4d83-a319-f061d6c434c6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.055221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb48bd28-a175-4f20-8f60-6d7d0d1a9cf4 admin admin] Security group rule updated ['2519351b-2b49-4620-bf60-e9a4a1810434'] Oct 09 00:57:35.080923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['e117ae0c-3834-457d-833e-82227f33c129'] and devices down [] completed. Oct 09 00:57:35.081510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:290 - ports processed. Elapsed:0.424 Oct 09 00:57:35.082087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:290 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.424 Oct 09 00:57:35.181373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port e117ae0c-3834-457d-833e-82227f33c129 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:35.181971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e117ae0c-3834-457d-833e-82227f33c129), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.280389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Resource SecurityGroup deleted: 1f64d3a4-4108-481e-a29c-19faa98a3dfe {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.281036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (1f64d3a4-4108-481e-a29c-19faa98a3dfe), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.281709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1f64d3a4-4108-481e-a29c-19faa98a3dfe',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:35.307629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Resource SecurityGroup deleted: 2519351b-2b49-4620-bf60-e9a4a1810434 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.308540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (2519351b-2b49-4620-bf60-e9a4a1810434), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.309142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2519351b-2b49-4620-bf60-e9a4a1810434',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:35.340717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1f64d3a4-4108-481e-a29c-19faa98a3dfe',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:35.341429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Resource SecurityGroupRule deleted: 1220e97d-611b-4f71-bfed-a8c65ad4712d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.342034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1220e97d-611b-4f71-bfed-a8c65ad4712d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.342574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Security group rule updated ['1f64d3a4-4108-481e-a29c-19faa98a3dfe'] Oct 09 00:57:35.343028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Resource SecurityGroupRule deleted: 80cd172e-e0bc-47a9-8647-b3244fc45fd4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.343585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (80cd172e-e0bc-47a9-8647-b3244fc45fd4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.344184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Security group rule updated ['1f64d3a4-4108-481e-a29c-19faa98a3dfe'] Oct 09 00:57:35.344779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Resource SecurityGroupRule deleted: b13d94ba-48f1-495d-b29b-abaa12a957f4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.345300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b13d94ba-48f1-495d-b29b-abaa12a957f4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.345812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Security group rule updated ['1f64d3a4-4108-481e-a29c-19faa98a3dfe'] Oct 09 00:57:35.346444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Resource SecurityGroupRule deleted: be03bc06-1d4c-4bf1-a740-23ef0f2e8032 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.347357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (be03bc06-1d4c-4bf1-a740-23ef0f2e8032), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.348017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5d3ca7fd-afe5-42be-8226-ecccbc93fab3 admin admin] Security group rule updated ['1f64d3a4-4108-481e-a29c-19faa98a3dfe'] Oct 09 00:57:35.359518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2519351b-2b49-4620-bf60-e9a4a1810434',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:35.360249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Resource SecurityGroupRule deleted: 1439e119-b29d-48c4-be76-6b1f57df90f5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.360803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1439e119-b29d-48c4-be76-6b1f57df90f5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.362915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Security group rule updated ['2519351b-2b49-4620-bf60-e9a4a1810434'] Oct 09 00:57:35.364186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Resource SecurityGroupRule deleted: 4a7e1fbf-fe8a-47d7-a2e3-f3982feb4ab3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.365422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4a7e1fbf-fe8a-47d7-a2e3-f3982feb4ab3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.367034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Security group rule updated ['2519351b-2b49-4620-bf60-e9a4a1810434'] Oct 09 00:57:35.369105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Resource SecurityGroupRule deleted: dc723890-0215-43f5-baf7-e80c17ffdf80 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.369621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (dc723890-0215-43f5-baf7-e80c17ffdf80), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.373125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Security group rule updated ['2519351b-2b49-4620-bf60-e9a4a1810434'] Oct 09 00:57:35.373686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Resource SecurityGroupRule deleted: f839095b-f337-4d83-a319-f061d6c434c6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:35.374185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f839095b-f337-4d83-a319-f061d6c434c6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:35.374786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2522293-820d-498c-8a5e-b5bb42df92a8 admin admin] Security group rule updated ['2519351b-2b49-4620-bf60-e9a4a1810434'] Oct 09 00:57:36.539981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:36Z,description='Default security group',id=45c53862-4d2e-4a2b-8557-6fc3144d7c39,is_default=True,name='default',project_id='8ddaf92644c048f39d70583218cec933',revision_number=1,rules=[SecurityGroupRule(0fd7fdde-aa18-4d6b-be33-50fdc50023ce),SecurityGroupRule(5bfb2d7b-4f7d-4b37-b5f3-66771effb832),SecurityGroupRule(e63b9b03-18f6-4615-b636-657387a1c233),SecurityGroupRule(fa08110a-eb6d-4fbc-9a2a-3cd9eadb4a4c)],shared=False,stateful=True,updated_at=2022-10-09T00:57:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:36.541196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (45c53862-4d2e-4a2b-8557-6fc3144d7c39), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.544991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:36Z,description=,direction='egress',ethertype='IPv4',id=0fd7fdde-aa18-4d6b-be33-50fdc50023ce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ddaf92644c048f39d70583218cec933',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45c53862-4d2e-4a2b-8557-6fc3144d7c39,updated_at=2022-10-09T00:57:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:36.545796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0fd7fdde-aa18-4d6b-be33-50fdc50023ce), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.546711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Security group rule updated ['45c53862-4d2e-4a2b-8557-6fc3144d7c39'] Oct 09 00:57:36.547892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:36Z,description=,direction='egress',ethertype='IPv6',id=5bfb2d7b-4f7d-4b37-b5f3-66771effb832,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ddaf92644c048f39d70583218cec933',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45c53862-4d2e-4a2b-8557-6fc3144d7c39,updated_at=2022-10-09T00:57:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:36.548576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5bfb2d7b-4f7d-4b37-b5f3-66771effb832), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.549142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Security group rule updated ['45c53862-4d2e-4a2b-8557-6fc3144d7c39'] Oct 09 00:57:36.553274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:36Z,description=,direction='ingress',ethertype='IPv6',id=e63b9b03-18f6-4615-b636-657387a1c233,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ddaf92644c048f39d70583218cec933',protocol=,remote_address_group_id=,remote_group_id=45c53862-4d2e-4a2b-8557-6fc3144d7c39,remote_ip_prefix=,revision_number=0,security_group_id=45c53862-4d2e-4a2b-8557-6fc3144d7c39,updated_at=2022-10-09T00:57:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:36.553780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e63b9b03-18f6-4615-b636-657387a1c233), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.554128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Security group rule updated ['45c53862-4d2e-4a2b-8557-6fc3144d7c39'] Oct 09 00:57:36.556246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:36Z,description=,direction='ingress',ethertype='IPv4',id=fa08110a-eb6d-4fbc-9a2a-3cd9eadb4a4c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ddaf92644c048f39d70583218cec933',protocol=,remote_address_group_id=,remote_group_id=45c53862-4d2e-4a2b-8557-6fc3144d7c39,remote_ip_prefix=,revision_number=0,security_group_id=45c53862-4d2e-4a2b-8557-6fc3144d7c39,updated_at=2022-10-09T00:57:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:36.556628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fa08110a-eb6d-4fbc-9a2a-3cd9eadb4a4c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.556964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03bb5b7e-8964-4c3b-b5fb-cbf147f66959 admin admin] Security group rule updated ['45c53862-4d2e-4a2b-8557-6fc3144d7c39'] Oct 09 00:57:36.658607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:291 started Oct 09 00:57:36.661173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=982000000,duration_sec=598,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:36.662006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:36.662344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:291 - starting polling. Elapsed:0.004 Oct 09 00:57:36.664566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.668011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:291 - port information retrieved. Elapsed:0.009 Oct 09 00:57:36.669919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'8909d97f-c5e3-462a-9bad-225ac2909771', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'e117ae0c-3834-457d-833e-82227f33c129'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:36.670708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'e117ae0c-3834-457d-833e-82227f33c129', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'network_id': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'port_id': 'e117ae0c-3834-457d-833e-82227f33c129', 'mac_address': 'fa:16:3e:bc:0d:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd7f3cba3-1b89-4cb1-b9ef-80793ce54a94', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:36.674542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e117ae0c-3834-457d-833e-82227f33c129 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:36.678227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e117ae0c-3834-457d-833e-82227f33c129 updated. Details: {'device': 'e117ae0c-3834-457d-833e-82227f33c129', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'network_id': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'port_id': 'e117ae0c-3834-457d-833e-82227f33c129', 'mac_address': 'fa:16:3e:bc:0d:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd7f3cba3-1b89-4cb1-b9ef-80793ce54a94', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Oct 09 00:57:36.682899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tape117ae0c-38, col_values=(('tag', 8),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:36.683459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tape117ae0c-38, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:36.684056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tape117ae0c-38, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:36.686108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:36.687103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tape117ae0c-38, col_values=(('other_config', {'net_uuid': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '681', 'tag': '8'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:36.690326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:36.697928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee68,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:36.699727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:291 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.028 Oct 09 00:57:36.700169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:57:36.700637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:57:36.703795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:36.704698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:36.717136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:36.796135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49b95955-bb75-42d1-9dc1-8c7c0594c0fa None None] Resource Port fb7aab07-c773-45fb-ab7c-b325d1a9f4ef updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=fb7aab07-c773-45fb-ab7c-b325d1a9f4ef,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fb7aab07-c773-45fb-ab7c-b325d1a9f4ef,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:36.796681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49b95955-bb75-42d1-9dc1-8c7c0594c0fa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (fb7aab07-c773-45fb-ab7c-b325d1a9f4ef), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.801132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Resource SecurityGroup deleted: 45c53862-4d2e-4a2b-8557-6fc3144d7c39 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:36.801664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (45c53862-4d2e-4a2b-8557-6fc3144d7c39), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.802279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('45c53862-4d2e-4a2b-8557-6fc3144d7c39',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:36.837923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a30f144-21a9-4ba4-ac83-5a1ad479a734]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:36.838811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:291 - agent port security group processed in 0.168 Oct 09 00:57:36.839830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for e117ae0c-3834-457d-833e-82227f33c129 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:36.859611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('45c53862-4d2e-4a2b-8557-6fc3144d7c39',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:36.860101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Resource SecurityGroupRule deleted: 0fd7fdde-aa18-4d6b-be33-50fdc50023ce {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:36.860476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0fd7fdde-aa18-4d6b-be33-50fdc50023ce), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.861561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Security group rule updated ['45c53862-4d2e-4a2b-8557-6fc3144d7c39'] Oct 09 00:57:36.862021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Resource SecurityGroupRule deleted: 5bfb2d7b-4f7d-4b37-b5f3-66771effb832 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:36.862369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5bfb2d7b-4f7d-4b37-b5f3-66771effb832), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.863860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Security group rule updated ['45c53862-4d2e-4a2b-8557-6fc3144d7c39'] Oct 09 00:57:36.864219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Resource SecurityGroupRule deleted: e63b9b03-18f6-4615-b636-657387a1c233 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:36.864570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e63b9b03-18f6-4615-b636-657387a1c233), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.864932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Security group rule updated ['45c53862-4d2e-4a2b-8557-6fc3144d7c39'] Oct 09 00:57:36.865303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Resource SecurityGroupRule deleted: fa08110a-eb6d-4fbc-9a2a-3cd9eadb4a4c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:36.865642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fa08110a-eb6d-4fbc-9a2a-3cd9eadb4a4c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:36.866240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a95b6ee7-eecf-453c-8e5f-e0ffe28ff5a7 admin admin] Security group rule updated ['45c53862-4d2e-4a2b-8557-6fc3144d7c39'] Oct 09 00:57:36.913488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0900a2a2-74bc-454c-9384-b28833ea2353 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:57:36Z,data_plane_status=None,description='',device_id='9d4c8a9c-2aee-4c52-9304-60a68ad85504',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=546af4ee-57b8-4aab-a465-e176e85a3fa1,mac_address=fa:16:3e:34:60:04,name='',network_id=51f66c80-6e94-4ac9-ad00-6dd9246260d1,numa_affinity_policy=,project_id='28bc82345ea24b929b66fbcded2b97b7',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(546af4ee-57b8-4aab-a465-e176e85a3fa1),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:57:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:36.915080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0900a2a2-74bc-454c-9384-b28833ea2353 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (546af4ee-57b8-4aab-a465-e176e85a3fa1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.198779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-49b95955-bb75-42d1-9dc1-8c7c0594c0fa None None] Resource Port fb7aab07-c773-45fb-ab7c-b325d1a9f4ef updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fb7aab07-c773-45fb-ab7c-b325d1a9f4ef,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fb7aab07-c773-45fb-ab7c-b325d1a9f4ef,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fb7aab07-c773-45fb-ab7c-b325d1a9f4ef,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:37.199159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-49b95955-bb75-42d1-9dc1-8c7c0594c0fa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (fb7aab07-c773-45fb-ab7c-b325d1a9f4ef), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.289481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['e117ae0c-3834-457d-833e-82227f33c129'] and devices down [] completed. Oct 09 00:57:37.290027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:291 - ports processed. Elapsed:0.632 Oct 09 00:57:37.290699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:291 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.632 Oct 09 00:57:37.523465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:37Z,description='Default security group',id=ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d,is_default=True,name='default',project_id='b03af7cb152a4c6ab87b38c24e1fe7af',revision_number=1,rules=[SecurityGroupRule(5dc3d7d4-0efb-40c8-b54b-8ed96ea3f3f4),SecurityGroupRule(66720166-fef8-44d8-b636-476dd2abba49),SecurityGroupRule(7e82de4e-4faa-48e6-a262-8d2d2c5ea83a),SecurityGroupRule(e9f39192-8b89-47fb-acc7-fbd274733d8e)],shared=False,stateful=True,updated_at=2022-10-09T00:57:37Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:37.523873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.524535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:37Z,description=,direction='egress',ethertype='IPv6',id=5dc3d7d4-0efb-40c8-b54b-8ed96ea3f3f4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b03af7cb152a4c6ab87b38c24e1fe7af',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d,updated_at=2022-10-09T00:57:37Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:37.525328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5dc3d7d4-0efb-40c8-b54b-8ed96ea3f3f4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.525826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Security group rule updated ['ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d'] Oct 09 00:57:37.526860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:37Z,description=,direction='ingress',ethertype='IPv6',id=66720166-fef8-44d8-b636-476dd2abba49,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b03af7cb152a4c6ab87b38c24e1fe7af',protocol=,remote_address_group_id=,remote_group_id=ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d,remote_ip_prefix=,revision_number=0,security_group_id=ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d,updated_at=2022-10-09T00:57:37Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:37.527388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (66720166-fef8-44d8-b636-476dd2abba49), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.527786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Security group rule updated ['ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d'] Oct 09 00:57:37.528493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:37Z,description=,direction='egress',ethertype='IPv4',id=7e82de4e-4faa-48e6-a262-8d2d2c5ea83a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b03af7cb152a4c6ab87b38c24e1fe7af',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d,updated_at=2022-10-09T00:57:37Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:37.528842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7e82de4e-4faa-48e6-a262-8d2d2c5ea83a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.529164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Security group rule updated ['ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d'] Oct 09 00:57:37.529818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:37Z,description=,direction='ingress',ethertype='IPv4',id=e9f39192-8b89-47fb-acc7-fbd274733d8e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b03af7cb152a4c6ab87b38c24e1fe7af',protocol=,remote_address_group_id=,remote_group_id=ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d,remote_ip_prefix=,revision_number=0,security_group_id=ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d,updated_at=2022-10-09T00:57:37Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:37.530164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e9f39192-8b89-47fb-acc7-fbd274733d8e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.531030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-03571596-8873-4da1-b0e0-e158741e0fb6 admin admin] Security group rule updated ['ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d'] Oct 09 00:57:37.585855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0900a2a2-74bc-454c-9384-b28833ea2353 admin admin] Received resource Port update without any changes: 546af4ee-57b8-4aab-a465-e176e85a3fa1 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 00:57:37.848847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Resource SecurityGroup deleted: ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:37.849256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.849677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:37.887374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8cb39c29-7f62-45fd-8af6-ca7ee8d7354a","insert","qg-fb7aab07-c7",["set",[]],["map",[["attached-mac","fa:16:3e:14:05:b1"],["iface-id","fb7aab07-c773-45fb-ab7c-b325d1a9f4ef"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:37.887374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8cb39c29-7f62-45fd-8af6-ca7ee8d7354a","old",null,["set",[]],null],["","new","qg-fb7aab07-c7",19,["map",[["attached-mac","fa:16:3e:14:05:b1"],["iface-id","fb7aab07-c773-45fb-ab7c-b325d1a9f4ef"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:37.893670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:37.894422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Resource SecurityGroupRule deleted: 5dc3d7d4-0efb-40c8-b54b-8ed96ea3f3f4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:37.894935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5dc3d7d4-0efb-40c8-b54b-8ed96ea3f3f4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.899607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Security group rule updated ['ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d'] Oct 09 00:57:37.900239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Resource SecurityGroupRule deleted: 66720166-fef8-44d8-b636-476dd2abba49 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:37.900740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (66720166-fef8-44d8-b636-476dd2abba49), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.901235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Security group rule updated ['ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d'] Oct 09 00:57:37.901768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Resource SecurityGroupRule deleted: 7e82de4e-4faa-48e6-a262-8d2d2c5ea83a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:37.902256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7e82de4e-4faa-48e6-a262-8d2d2c5ea83a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.902724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Security group rule updated ['ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d'] Oct 09 00:57:37.903539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Resource SecurityGroupRule deleted: e9f39192-8b89-47fb-acc7-fbd274733d8e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:37.904082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e9f39192-8b89-47fb-acc7-fbd274733d8e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:37.904933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b82b2de7-1485-411a-bae1-6f4e230a2716 admin admin] Security group rule updated ['ad75c64f-ab2c-4bc7-b04e-7c6f29816e3d'] Oct 09 00:57:38.660900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:292 started Oct 09 00:57:38.664507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=985000000,duration_sec=600,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:38.665249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:38.666112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:292 - starting polling. Elapsed:0.006 Oct 09 00:57:38.668672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:38.671943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:292 - port information retrieved. Elapsed:0.012 Oct 09 00:57:38.672531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'}, 'removed': set(), 'updated': {'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:38.673373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', 'device_id': '9d4c8a9c-2aee-4c52-9304-60a68ad85504', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', 'mac_address': 'fa:16:3e:14:05:b1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.171'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:38.680390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: fb7aab07-c773-45fb-ab7c-b325d1a9f4ef {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:38.681442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port fb7aab07-c773-45fb-ab7c-b325d1a9f4ef updated. Details: {'device': 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', 'device_id': '9d4c8a9c-2aee-4c52-9304-60a68ad85504', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', 'mac_address': 'fa:16:3e:14:05:b1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.171'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:57:38.682864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fb7aab07-c7, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:38.683478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-fb7aab07-c7, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:38.684120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-fb7aab07-c7, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:38.692588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fb7aab07-c7, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:38.701048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee6c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:38.701487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:292 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.028 Oct 09 00:57:38.702357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:57:38.702813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'} Oct 09 00:57:38.703978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:38.704552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:38.709312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:38.765665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3f3062-d69a-4622-bf51-8db990f28d2a]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:38.766283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:292 - agent port security group processed in 0.093 Oct 09 00:57:38.767105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for fb7aab07-c773-45fb-ab7c-b325d1a9f4ef to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:38.948045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'] and devices down [] completed. Oct 09 00:57:38.949002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:292 - ports processed. Elapsed:0.288 Oct 09 00:57:38.949775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:292 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.289 Oct 09 00:57:39.028358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port fb7aab07-c773-45fb-ab7c-b325d1a9f4ef updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fb7aab07-c773-45fb-ab7c-b325d1a9f4ef,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fb7aab07-c773-45fb-ab7c-b325d1a9f4ef,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:39.028730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (fb7aab07-c773-45fb-ab7c-b325d1a9f4ef), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:39.059631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:38Z,description='Default security group',id=eafb91c1-05f4-4b2f-a40a-859b9fa695a2,is_default=True,name='default',project_id='cac43224e7954c44a71839707ffcde6c',revision_number=1,rules=[SecurityGroupRule(1ca30ed6-ed39-497e-970d-eb52c1c3f288),SecurityGroupRule(5be98686-0f71-48b5-b101-e5d7d0319745),SecurityGroupRule(6d0ce77b-311e-4801-8a7e-5e10735528c7),SecurityGroupRule(e2d72448-632c-4e60-a555-c55b5f7d4191)],shared=False,stateful=True,updated_at=2022-10-09T00:57:38Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:39.060125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (eafb91c1-05f4-4b2f-a40a-859b9fa695a2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:39.060835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:38Z,description=,direction='egress',ethertype='IPv4',id=1ca30ed6-ed39-497e-970d-eb52c1c3f288,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cac43224e7954c44a71839707ffcde6c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eafb91c1-05f4-4b2f-a40a-859b9fa695a2,updated_at=2022-10-09T00:57:38Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:39.061775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1ca30ed6-ed39-497e-970d-eb52c1c3f288), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:39.062189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Security group rule updated ['eafb91c1-05f4-4b2f-a40a-859b9fa695a2'] Oct 09 00:57:39.063220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:38Z,description=,direction='ingress',ethertype='IPv6',id=5be98686-0f71-48b5-b101-e5d7d0319745,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cac43224e7954c44a71839707ffcde6c',protocol=,remote_address_group_id=,remote_group_id=eafb91c1-05f4-4b2f-a40a-859b9fa695a2,remote_ip_prefix=,revision_number=0,security_group_id=eafb91c1-05f4-4b2f-a40a-859b9fa695a2,updated_at=2022-10-09T00:57:38Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:39.063705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5be98686-0f71-48b5-b101-e5d7d0319745), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:39.064232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Security group rule updated ['eafb91c1-05f4-4b2f-a40a-859b9fa695a2'] Oct 09 00:57:39.066276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:38Z,description=,direction='egress',ethertype='IPv6',id=6d0ce77b-311e-4801-8a7e-5e10735528c7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cac43224e7954c44a71839707ffcde6c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eafb91c1-05f4-4b2f-a40a-859b9fa695a2,updated_at=2022-10-09T00:57:38Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:39.069585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6d0ce77b-311e-4801-8a7e-5e10735528c7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:39.072343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Security group rule updated ['eafb91c1-05f4-4b2f-a40a-859b9fa695a2'] Oct 09 00:57:39.073499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:38Z,description=,direction='ingress',ethertype='IPv4',id=e2d72448-632c-4e60-a555-c55b5f7d4191,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cac43224e7954c44a71839707ffcde6c',protocol=,remote_address_group_id=,remote_group_id=eafb91c1-05f4-4b2f-a40a-859b9fa695a2,remote_ip_prefix=,revision_number=0,security_group_id=eafb91c1-05f4-4b2f-a40a-859b9fa695a2,updated_at=2022-10-09T00:57:38Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:39.074451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e2d72448-632c-4e60-a555-c55b5f7d4191), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:39.075047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Security group rule updated ['eafb91c1-05f4-4b2f-a40a-859b9fa695a2'] Oct 09 00:57:39.219765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:57:39Z,description='',dns_domain=None,id=db7e2df3-cfef-4dc0-bfd4-74237b8cf94f,mtu=1500,name='tempest-TestVolumeBootPattern-1238250282-network',project_id='cac43224e7954c44a71839707ffcde6c',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(db7e2df3-cfef-4dc0-bfd4-74237b8cf94f),segments=[NetworkSegment(3b1d95db-40fe-4632-8a0b-968f83cd1430)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:57:39Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:39.220404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (db7e2df3-cfef-4dc0-bfd4-74237b8cf94f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-395fd150-be82-45ba-8ab1-037de8a11f09 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network db7e2df3-cfef-4dc0-bfd4-74237b8cf94f with segmentation id not found. Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:57:39.319675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:57:39.320515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:57:39.320515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:57:39.320515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:57:39.320515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network db7e2df3-cfef-4dc0-bfd4-74237b8cf94f with segmentation id not found. Oct 09 00:57:39.320515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:57:39.609722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1c1882c9-c01b-49b6-96e6-8e658c1240d0 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(9b85a129-2882-4b8e-b2cc-d24497b7d6e6)],cidr=172.20.0.0/28,created_at=2022-10-09T00:57:39Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=3b0167a8-9316-47c8-b78a-93b4c6f720b5,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-1238250282-subnet',network_id=db7e2df3-cfef-4dc0-bfd4-74237b8cf94f,project_id='cac43224e7954c44a71839707ffcde6c',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:57:39Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:39.610357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1c1882c9-c01b-49b6-96e6-8e658c1240d0 admin admin] Publish callbacks [] for Subnet (3b0167a8-9316-47c8-b78a-93b4c6f720b5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:40.308005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d4c3dccf-d7dc-4c0a-9939-7e1e610c9ca9 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:57:39Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-db7e2df3-cfef-4dc0-bfd4-74237b8cf94f',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=79dc7d7f-004a-4e23-b50f-7ca413583909,mac_address=fa:16:3e:e4:bc:c1,name='',network_id=db7e2df3-cfef-4dc0-bfd4-74237b8cf94f,numa_affinity_policy=,project_id='cac43224e7954c44a71839707ffcde6c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(79dc7d7f-004a-4e23-b50f-7ca413583909),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:57:40Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:40.308631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d4c3dccf-d7dc-4c0a-9939-7e1e610c9ca9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (79dc7d7f-004a-4e23-b50f-7ca413583909), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:40.661249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:293 started Oct 09 00:57:40.664734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=985000000,duration_sec=602,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:40.665718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:40.666116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:293 - starting polling. Elapsed:0.005 Oct 09 00:57:40.668665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:40.676629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:293 - port information retrieved. Elapsed:0.015 Oct 09 00:57:40.677453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:40.683688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', 'device_id': '9d4c8a9c-2aee-4c52-9304-60a68ad85504', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', 'mac_address': 'fa:16:3e:14:05:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.171'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:40.695283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: fb7aab07-c773-45fb-ab7c-b325d1a9f4ef {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:40.695863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port fb7aab07-c773-45fb-ab7c-b325d1a9f4ef updated. Details: {'device': 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', 'device_id': '9d4c8a9c-2aee-4c52-9304-60a68ad85504', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', 'mac_address': 'fa:16:3e:14:05:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.171'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:57:40.699339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fb7aab07-c7, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:40.703460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-fb7aab07-c7, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:40.706009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-fb7aab07-c7, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:40.707222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:40.710123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fb7aab07-c7, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:40.712816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:40.723333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee70,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:40.726485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:293 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.042 Oct 09 00:57:40.727030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:57:40.727492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:57:40.729110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:40.730701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:40.736386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:40.814781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-497eef4e-c0e5-459c-b246-2c4ede0ea83f None None] Resource Port 546af4ee-57b8-4aab-a465-e176e85a3fa1 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=546af4ee-57b8-4aab-a465-e176e85a3fa1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=546af4ee-57b8-4aab-a465-e176e85a3fa1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:40.815265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-497eef4e-c0e5-459c-b246-2c4ede0ea83f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (546af4ee-57b8-4aab-a465-e176e85a3fa1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:40.826095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0f60e-d675-4eaf-8cfc-6e00e9a8fe19]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:40.827169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:293 - agent port security group processed in 0.144 Oct 09 00:57:40.828441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for fb7aab07-c773-45fb-ab7c-b325d1a9f4ef to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:40.843279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d4c3dccf-d7dc-4c0a-9939-7e1e610c9ca9 None None] Resource Port 79dc7d7f-004a-4e23-b50f-7ca413583909 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=79dc7d7f-004a-4e23-b50f-7ca413583909,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=79dc7d7f-004a-4e23-b50f-7ca413583909,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=79dc7d7f-004a-4e23-b50f-7ca413583909,segment=NetworkSegment(3b1d95db-40fe-4632-8a0b-968f83cd1430),segment_id=3b1d95db-40fe-4632-8a0b-968f83cd1430)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:40.844257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d4c3dccf-d7dc-4c0a-9939-7e1e610c9ca9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (79dc7d7f-004a-4e23-b50f-7ca413583909), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:41.098693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4deb8e2a-26b1-4ce4-b668-9a0d8227a803","insert","tap79dc7d7f-00",["set",[]],["map",[["attached-mac","fa:16:3e:e4:bc:c1"],["iface-id","79dc7d7f-004a-4e23-b50f-7ca413583909"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:41.143663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4deb8e2a-26b1-4ce4-b668-9a0d8227a803","old",null,["set",[]],null],["","new","tap79dc7d7f-00",20,["map",[["attached-mac","fa:16:3e:e4:bc:c1"],["iface-id","79dc7d7f-004a-4e23-b50f-7ca413583909"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:41.190643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'] and devices down [] completed. Oct 09 00:57:41.191231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:293 - ports processed. Elapsed:0.530 Oct 09 00:57:41.191752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:293 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.531 Oct 09 00:57:41.375274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-497eef4e-c0e5-459c-b246-2c4ede0ea83f None None] Resource Port 546af4ee-57b8-4aab-a465-e176e85a3fa1 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=546af4ee-57b8-4aab-a465-e176e85a3fa1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=546af4ee-57b8-4aab-a465-e176e85a3fa1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=546af4ee-57b8-4aab-a465-e176e85a3fa1,segment=NetworkSegment(9512762e-780c-464c-a567-4995173eb1a6),segment_id=9512762e-780c-464c-a567-4995173eb1a6)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:41.375931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-497eef4e-c0e5-459c-b246-2c4ede0ea83f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (546af4ee-57b8-4aab-a465-e176e85a3fa1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:41.605890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0a50a491-3f56-451a-aee2-e555f3279661 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:57:40Z,data_plane_status=None,description='',device_id='f3789d4a-963a-496a-91ee-a84328d73cb8',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a642f240-21a3-4c54-8d26-c38ff0409d76,mac_address=fa:16:3e:0f:65:3e,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a642f240-21a3-4c54-8d26-c38ff0409d76),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:57:40Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:41.606400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0a50a491-3f56-451a-aee2-e555f3279661 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a642f240-21a3-4c54-8d26-c38ff0409d76), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:41.858360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["264293d2-2162-46df-97e5-63583e37003b","insert","qr-546af4ee-57",["set",[]],["map",[["attached-mac","fa:16:3e:34:60:04"],["iface-id","546af4ee-57b8-4aab-a465-e176e85a3fa1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:41.873794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["264293d2-2162-46df-97e5-63583e37003b","old",null,["set",[]],null],["","new","qr-546af4ee-57",21,["map",[["attached-mac","fa:16:3e:34:60:04"],["iface-id","546af4ee-57b8-4aab-a465-e176e85a3fa1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:42.662756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:294 started Oct 09 00:57:42.666791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=987000000,duration_sec=604,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:42.667571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:42.668285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:294 - starting polling. Elapsed:0.006 Oct 09 00:57:42.670884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:42.677066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:294 - port information retrieved. Elapsed:0.014 Oct 09 00:57:42.677590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '79dc7d7f-004a-4e23-b50f-7ca413583909', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'79dc7d7f-004a-4e23-b50f-7ca413583909', '546af4ee-57b8-4aab-a465-e176e85a3fa1'}, 'removed': set(), 'updated': {'79dc7d7f-004a-4e23-b50f-7ca413583909', '546af4ee-57b8-4aab-a465-e176e85a3fa1'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:42.678347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '79dc7d7f-004a-4e23-b50f-7ca413583909', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'network_id': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'port_id': '79dc7d7f-004a-4e23-b50f-7ca413583909', 'mac_address': 'fa:16:3e:e4:bc:c1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3b0167a8-9316-47c8-b78a-93b4c6f720b5', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:42.678978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'device_id': '9d4c8a9c-2aee-4c52-9304-60a68ad85504', 'network_id': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'port_id': '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'mac_address': 'fa:16:3e:34:60:04', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd7f3cba3-1b89-4cb1-b9ef-80793ce54a94', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:42.688289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 79dc7d7f-004a-4e23-b50f-7ca413583909 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:42.688955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 79dc7d7f-004a-4e23-b50f-7ca413583909 updated. Details: {'device': '79dc7d7f-004a-4e23-b50f-7ca413583909', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'network_id': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'port_id': '79dc7d7f-004a-4e23-b50f-7ca413583909', 'mac_address': 'fa:16:3e:e4:bc:c1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3b0167a8-9316-47c8-b78a-93b4c6f720b5', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 00:57:42.689651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 9 as local vlan for net-id=db7e2df3-cfef-4dc0-bfd4-74237b8cf94f, seg-id=687 Oct 09 00:57:42.700854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da1833,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4783), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:42.707483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363ee74,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4105)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4783}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:42.710327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap79dc7d7f-00, col_values=(('tag', 9),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:42.710937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap79dc7d7f-00, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:42.714458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap79dc7d7f-00, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:42.732586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap79dc7d7f-00, col_values=(('other_config', {'net_uuid': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '687'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:42.752728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee76,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:42.755408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 546af4ee-57b8-4aab-a465-e176e85a3fa1 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:42.755915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 546af4ee-57b8-4aab-a465-e176e85a3fa1 updated. Details: {'device': '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'device_id': '9d4c8a9c-2aee-4c52-9304-60a68ad85504', 'network_id': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'port_id': '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'mac_address': 'fa:16:3e:34:60:04', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd7f3cba3-1b89-4cb1-b9ef-80793ce54a94', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Oct 09 00:57:42.757096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-546af4ee-57, col_values=(('tag', 8),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:42.758523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-546af4ee-57, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:42.760013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-546af4ee-57, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:42.777001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-546af4ee-57, col_values=(('other_config', {'net_uuid': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '681'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:42.802314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6add4936-d088-4679-b9a3-a28f94412b79 None None] Resource Port 79dc7d7f-004a-4e23-b50f-7ca413583909 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:42.802701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6add4936-d088-4679-b9a3-a28f94412b79 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (79dc7d7f-004a-4e23-b50f-7ca413583909), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:42.819906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee78,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:42.819906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:294 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.134 Oct 09 00:57:42.819906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 2 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:57:42.819906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'79dc7d7f-004a-4e23-b50f-7ca413583909', '546af4ee-57b8-4aab-a465-e176e85a3fa1'} Oct 09 00:57:42.819906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:42.820270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:42.830686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:42.925275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2b1c9c-cab4-4dac-8f58-a3f5b72a400c]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:42.925929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:294 - agent port security group processed in 0.248 Oct 09 00:57:42.926758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 79dc7d7f-004a-4e23-b50f-7ca413583909 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:42.927030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 546af4ee-57b8-4aab-a465-e176e85a3fa1 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:43.776456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fbdcac20-9998-4ece-b84a-4340f12188aa admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:57:43Z,data_plane_status=None,description='',device_id='f3789d4a-963a-496a-91ee-a84328d73cb8',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=694ef31e-6f15-4593-9990-eb27b05a49e8,mac_address=fa:16:3e:d3:3f:32,name='',network_id=db7e2df3-cfef-4dc0-bfd4-74237b8cf94f,numa_affinity_policy=,project_id='cac43224e7954c44a71839707ffcde6c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(694ef31e-6f15-4593-9990-eb27b05a49e8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:57:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:43.779841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fbdcac20-9998-4ece-b84a-4340f12188aa admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (694ef31e-6f15-4593-9990-eb27b05a49e8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:43.929538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['79dc7d7f-004a-4e23-b50f-7ca413583909', '546af4ee-57b8-4aab-a465-e176e85a3fa1'] and devices down [] completed. Oct 09 00:57:43.930729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:294 - ports processed. Elapsed:1.268 Oct 09 00:57:43.931379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:294 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:1.269 Oct 09 00:57:44.057943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 546af4ee-57b8-4aab-a465-e176e85a3fa1 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:44.064330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (546af4ee-57b8-4aab-a465-e176e85a3fa1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:44.141701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e08b295c-7e26-4923-9522-402d383a8672 None None] Resource Port a642f240-21a3-4c54-8d26-c38ff0409d76 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=a642f240-21a3-4c54-8d26-c38ff0409d76,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a642f240-21a3-4c54-8d26-c38ff0409d76,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:44.142374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e08b295c-7e26-4923-9522-402d383a8672 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a642f240-21a3-4c54-8d26-c38ff0409d76), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:44.247167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fbdcac20-9998-4ece-b84a-4340f12188aa admin admin] Received resource Port update without any changes: 694ef31e-6f15-4593-9990-eb27b05a49e8 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 00:57:44.286920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e08b295c-7e26-4923-9522-402d383a8672 None None] Resource Port a642f240-21a3-4c54-8d26-c38ff0409d76 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a642f240-21a3-4c54-8d26-c38ff0409d76,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a642f240-21a3-4c54-8d26-c38ff0409d76,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a642f240-21a3-4c54-8d26-c38ff0409d76,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:44.287435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e08b295c-7e26-4923-9522-402d383a8672 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a642f240-21a3-4c54-8d26-c38ff0409d76), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:44.663579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:295 started Oct 09 00:57:44.666490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=987000000,duration_sec=606,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:44.667055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:44.667392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:295 - starting polling. Elapsed:0.004 Oct 09 00:57:44.670365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:44.673520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:295 - port information retrieved. Elapsed:0.010 Oct 09 00:57:44.674253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'79dc7d7f-004a-4e23-b50f-7ca413583909', '546af4ee-57b8-4aab-a465-e176e85a3fa1'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:44.675100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '79dc7d7f-004a-4e23-b50f-7ca413583909', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'network_id': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'port_id': '79dc7d7f-004a-4e23-b50f-7ca413583909', 'mac_address': 'fa:16:3e:e4:bc:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3b0167a8-9316-47c8-b78a-93b4c6f720b5', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:44.676162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'device_id': '9d4c8a9c-2aee-4c52-9304-60a68ad85504', 'network_id': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'port_id': '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'mac_address': 'fa:16:3e:34:60:04', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd7f3cba3-1b89-4cb1-b9ef-80793ce54a94', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:44.679243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 79dc7d7f-004a-4e23-b50f-7ca413583909 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:44.679565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 79dc7d7f-004a-4e23-b50f-7ca413583909 updated. Details: {'device': '79dc7d7f-004a-4e23-b50f-7ca413583909', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'network_id': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'port_id': '79dc7d7f-004a-4e23-b50f-7ca413583909', 'mac_address': 'fa:16:3e:e4:bc:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3b0167a8-9316-47c8-b78a-93b4c6f720b5', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 09 00:57:44.684292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap79dc7d7f-00, col_values=(('tag', 9),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:44.684877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap79dc7d7f-00, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:44.685430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap79dc7d7f-00, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:44.686018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:44.687328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap79dc7d7f-00, col_values=(('other_config', {'net_uuid': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '687', 'tag': '9'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:44.687976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:44.690192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee7c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:44.690515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 546af4ee-57b8-4aab-a465-e176e85a3fa1 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:44.691020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 546af4ee-57b8-4aab-a465-e176e85a3fa1 updated. Details: {'device': '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'device_id': '9d4c8a9c-2aee-4c52-9304-60a68ad85504', 'network_id': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'port_id': '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'mac_address': 'fa:16:3e:34:60:04', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 681, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd7f3cba3-1b89-4cb1-b9ef-80793ce54a94', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Oct 09 00:57:44.691925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-546af4ee-57, col_values=(('tag', 8),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:44.692340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-546af4ee-57, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:44.692729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-546af4ee-57, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:44.693151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:44.693859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-546af4ee-57, col_values=(('other_config', {'net_uuid': '51f66c80-6e94-4ac9-ad00-6dd9246260d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '681', 'tag': '8'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:44.694520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:44.696869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee7e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:44.697365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:295 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.023 Oct 09 00:57:44.697723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:57:44.698008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:57:44.699766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:44.700051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:44.704679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:44.756301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7f0f26-21f0-4dcb-aad1-018633b0288e]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:44.758263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:295 - agent port security group processed in 0.084 Oct 09 00:57:44.759104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 79dc7d7f-004a-4e23-b50f-7ca413583909 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:44.759386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 546af4ee-57b8-4aab-a465-e176e85a3fa1 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:44.792774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["985271c0-7ad9-429f-8c1c-ec6b6f470afc","insert","qr-694ef31e-6f",["set",[]],["map",[["attached-mac","fa:16:3e:d3:3f:32"],["iface-id","694ef31e-6f15-4593-9990-eb27b05a49e8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:44.821982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["985271c0-7ad9-429f-8c1c-ec6b6f470afc","old",null,["set",[]],null],["","new","qr-694ef31e-6f",22,["map",[["attached-mac","fa:16:3e:d3:3f:32"],["iface-id","694ef31e-6f15-4593-9990-eb27b05a49e8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:45.086730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['79dc7d7f-004a-4e23-b50f-7ca413583909', '546af4ee-57b8-4aab-a465-e176e85a3fa1'] and devices down [] completed. Oct 09 00:57:45.087112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:295 - ports processed. Elapsed:0.424 Oct 09 00:57:45.087448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:295 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.424 Oct 09 00:57:45.172601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd77e2fb-1791-4f03-8b59-1a0959a33b2e tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:45Z,description='tempest-secgroup-smoke-606774372 description',id=45da6575-619b-423b-bc04-7f831c564029,is_default=False,name='tempest-secgroup-smoke-606774372',project_id='28bc82345ea24b929b66fbcded2b97b7',revision_number=1,rules=[SecurityGroupRule(b23da15f-5d69-4f41-be0a-c96a3e48baae),SecurityGroupRule(de4f58ee-209d-48d6-a3f0-109a2f5cb550)],shared=False,stateful=True,updated_at=2022-10-09T00:57:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:45.172995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd77e2fb-1791-4f03-8b59-1a0959a33b2e tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (45da6575-619b-423b-bc04-7f831c564029), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:45.173633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd77e2fb-1791-4f03-8b59-1a0959a33b2e tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:45Z,description=,direction='egress',ethertype='IPv4',id=b23da15f-5d69-4f41-be0a-c96a3e48baae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45da6575-619b-423b-bc04-7f831c564029,updated_at=2022-10-09T00:57:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:45.173994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd77e2fb-1791-4f03-8b59-1a0959a33b2e tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b23da15f-5d69-4f41-be0a-c96a3e48baae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:45.174330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fd77e2fb-1791-4f03-8b59-1a0959a33b2e tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 00:57:45.175014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fd77e2fb-1791-4f03-8b59-1a0959a33b2e tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:45Z,description=,direction='egress',ethertype='IPv6',id=de4f58ee-209d-48d6-a3f0-109a2f5cb550,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45da6575-619b-423b-bc04-7f831c564029,updated_at=2022-10-09T00:57:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:45.176090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fd77e2fb-1791-4f03-8b59-1a0959a33b2e tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (de4f58ee-209d-48d6-a3f0-109a2f5cb550), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:45.176275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fd77e2fb-1791-4f03-8b59-1a0959a33b2e tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 00:57:45.282446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["019b1241-d5aa-4254-9407-ddd2c0c0849f","insert","qg-a642f240-21",["set",[]],["map",[["attached-mac","fa:16:3e:0f:65:3e"],["iface-id","a642f240-21a3-4c54-8d26-c38ff0409d76"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:45.304904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["019b1241-d5aa-4254-9407-ddd2c0c0849f","old",null,["set",[]],null],["","new","qg-a642f240-21",23,["map",[["attached-mac","fa:16:3e:0f:65:3e"],["iface-id","a642f240-21a3-4c54-8d26-c38ff0409d76"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 00:57:45.377857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ff09be1a-9fa0-4338-9380-12291c6baae0 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:45Z,description='',direction='ingress',ethertype='IPv4',id=f3df4d8c-5f21-488a-a1e5-cf490baf7401,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45da6575-619b-423b-bc04-7f831c564029,updated_at=2022-10-09T00:57:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:45.378364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ff09be1a-9fa0-4338-9380-12291c6baae0 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f3df4d8c-5f21-488a-a1e5-cf490baf7401), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:45.378736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ff09be1a-9fa0-4338-9380-12291c6baae0 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 00:57:45.539329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-92dec649-5b60-4708-b29a-3e446e8d04c8 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:45Z,description='',direction='egress',ethertype='IPv4',id=47033289-16c5-4d4d-9760-1b4d0b7428a4,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45da6575-619b-423b-bc04-7f831c564029,updated_at=2022-10-09T00:57:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:45.539751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-92dec649-5b60-4708-b29a-3e446e8d04c8 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (47033289-16c5-4d4d-9760-1b4d0b7428a4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:45.540262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-92dec649-5b60-4708-b29a-3e446e8d04c8 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 00:57:45.725242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-08e515db-2720-43b9-9cc1-38bce89ade4d tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:45Z,description='',direction='ingress',ethertype='IPv4',id=767e9ff3-870f-4b46-a7c1-deabf3861797,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45da6575-619b-423b-bc04-7f831c564029,updated_at=2022-10-09T00:57:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:45.725956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-08e515db-2720-43b9-9cc1-38bce89ade4d tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (767e9ff3-870f-4b46-a7c1-deabf3861797), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:45.726629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-08e515db-2720-43b9-9cc1-38bce89ade4d tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 00:57:45.893789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c5db3d04-1060-47f9-8e22-abd710eefd93 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:45Z,description='',direction='egress',ethertype='IPv4',id=59becfc4-1d9d-4a58-86a7-2a135ae48fff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45da6575-619b-423b-bc04-7f831c564029,updated_at=2022-10-09T00:57:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:45.894501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c5db3d04-1060-47f9-8e22-abd710eefd93 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (59becfc4-1d9d-4a58-86a7-2a135ae48fff), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:45.896319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c5db3d04-1060-47f9-8e22-abd710eefd93 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 00:57:46.033989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2800da27-1891-483b-91a8-3eef44c6febe tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:45Z,description='',direction='ingress',ethertype='IPv6',id=5c87d8c0-b4b3-4ff8-9320-02ea542ff7f6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45da6575-619b-423b-bc04-7f831c564029,updated_at=2022-10-09T00:57:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:46.034365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2800da27-1891-483b-91a8-3eef44c6febe tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5c87d8c0-b4b3-4ff8-9320-02ea542ff7f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:46.034694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2800da27-1891-483b-91a8-3eef44c6febe tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 00:57:46.165497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c11bf178-3864-4a33-a535-a501b0d6a6e7 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:46Z,description='',direction='egress',ethertype='IPv6',id=8dbd829f-87b0-47b9-9561-69a5a19f9253,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28bc82345ea24b929b66fbcded2b97b7',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=45da6575-619b-423b-bc04-7f831c564029,updated_at=2022-10-09T00:57:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:46.165919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c11bf178-3864-4a33-a535-a501b0d6a6e7 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8dbd829f-87b0-47b9-9561-69a5a19f9253), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:46.166262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c11bf178-3864-4a33-a535-a501b0d6a6e7 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 00:57:46.664982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:296 started Oct 09 00:57:46.672604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=991000000,duration_sec=608,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:46.675247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:46.677220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:296 - starting polling. Elapsed:0.012 Oct 09 00:57:46.682752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:46.698963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:296 - port information retrieved. Elapsed:0.034 Oct 09 00:57:46.699619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': {'694ef31e-6f15-4593-9990-eb27b05a49e8', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:46.700557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:57:43Z,data_plane_status=None,description='',device_id='f3789d4a-963a-496a-91ee-a84328d73cb8',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=694ef31e-6f15-4593-9990-eb27b05a49e8,mac_address=fa:16:3e:d3:3f:32,name='',network_id=db7e2df3-cfef-4dc0-bfd4-74237b8cf94f,numa_affinity_policy=,project_id='cac43224e7954c44a71839707ffcde6c',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(694ef31e-6f15-4593-9990-eb27b05a49e8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T00:57:43Z) is not bound. Oct 09 00:57:46.701591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'a642f240-21a3-4c54-8d26-c38ff0409d76', 'device_id': 'f3789d4a-963a-496a-91ee-a84328d73cb8', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'a642f240-21a3-4c54-8d26-c38ff0409d76', 'mac_address': 'fa:16:3e:0f:65:3e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.5'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:46.722358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 694ef31e-6f15-4593-9990-eb27b05a49e8 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:46.722928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device 694ef31e-6f15-4593-9990-eb27b05a49e8 not defined on plugin or binding failed Oct 09 00:57:46.723693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: a642f240-21a3-4c54-8d26-c38ff0409d76 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:46.724253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port a642f240-21a3-4c54-8d26-c38ff0409d76 updated. Details: {'device': 'a642f240-21a3-4c54-8d26-c38ff0409d76', 'device_id': 'f3789d4a-963a-496a-91ee-a84328d73cb8', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'a642f240-21a3-4c54-8d26-c38ff0409d76', 'mac_address': 'fa:16:3e:0f:65:3e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.5'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:57:46.725902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a642f240-21, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:46.727857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-a642f240-21, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:46.730172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-a642f240-21, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:46.741072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a642f240-21, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:46.753103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee82,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:46.755814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:296 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.056 Oct 09 00:57:46.756420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 2 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 00:57:46.756982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'694ef31e-6f15-4593-9990-eb27b05a49e8', 'a642f240-21a3-4c54-8d26-c38ff0409d76'} Oct 09 00:57:46.759740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:46.761073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:46.767829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:46.826700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc9d8fd-63b5-48de-bf13-f4d019894426]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:46.827326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:296 - agent port security group processed in 0.127 Oct 09 00:57:46.828226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for a642f240-21a3-4c54-8d26-c38ff0409d76 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:47.023057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['a642f240-21a3-4c54-8d26-c38ff0409d76'] and devices down [] completed. Oct 09 00:57:47.023693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:296 - ports processed. Elapsed:0.359 Oct 09 00:57:47.023798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:296 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.359 Oct 09 00:57:47.082311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port a642f240-21a3-4c54-8d26-c38ff0409d76 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a642f240-21a3-4c54-8d26-c38ff0409d76,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a642f240-21a3-4c54-8d26-c38ff0409d76,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:47.083032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a642f240-21a3-4c54-8d26-c38ff0409d76), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:47.940516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f7c1d0b4-63f8-43d5-8e7c-d84769c78777 None None] Resource Port 694ef31e-6f15-4593-9990-eb27b05a49e8 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=694ef31e-6f15-4593-9990-eb27b05a49e8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=694ef31e-6f15-4593-9990-eb27b05a49e8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:47.942649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f7c1d0b4-63f8-43d5-8e7c-d84769c78777 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (694ef31e-6f15-4593-9990-eb27b05a49e8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:48.263348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f7c1d0b4-63f8-43d5-8e7c-d84769c78777 None None] Resource Port 694ef31e-6f15-4593-9990-eb27b05a49e8 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=694ef31e-6f15-4593-9990-eb27b05a49e8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=694ef31e-6f15-4593-9990-eb27b05a49e8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=694ef31e-6f15-4593-9990-eb27b05a49e8,segment=NetworkSegment(3b1d95db-40fe-4632-8a0b-968f83cd1430),segment_id=3b1d95db-40fe-4632-8a0b-968f83cd1430)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:48.265847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f7c1d0b4-63f8-43d5-8e7c-d84769c78777 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (694ef31e-6f15-4593-9990-eb27b05a49e8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:48.675189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:297 started Oct 09 00:57:48.675189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=990000000,duration_sec=610,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:48.675189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:48.675189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:297 - starting polling. Elapsed:0.004 Oct 09 00:57:48.676332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:48.676759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:297 - port information retrieved. Elapsed:0.011 Oct 09 00:57:48.677105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'694ef31e-6f15-4593-9990-eb27b05a49e8', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:48.677668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '694ef31e-6f15-4593-9990-eb27b05a49e8', 'device_id': 'f3789d4a-963a-496a-91ee-a84328d73cb8', 'network_id': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'port_id': '694ef31e-6f15-4593-9990-eb27b05a49e8', 'mac_address': 'fa:16:3e:d3:3f:32', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3b0167a8-9316-47c8-b78a-93b4c6f720b5', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:48.684259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'a642f240-21a3-4c54-8d26-c38ff0409d76', 'device_id': 'f3789d4a-963a-496a-91ee-a84328d73cb8', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'a642f240-21a3-4c54-8d26-c38ff0409d76', 'mac_address': 'fa:16:3e:0f:65:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.5'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:48.688099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 694ef31e-6f15-4593-9990-eb27b05a49e8 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:48.688452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 694ef31e-6f15-4593-9990-eb27b05a49e8 updated. Details: {'device': '694ef31e-6f15-4593-9990-eb27b05a49e8', 'device_id': 'f3789d4a-963a-496a-91ee-a84328d73cb8', 'network_id': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'port_id': '694ef31e-6f15-4593-9990-eb27b05a49e8', 'mac_address': 'fa:16:3e:d3:3f:32', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3b0167a8-9316-47c8-b78a-93b4c6f720b5', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 09 00:57:48.689467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-694ef31e-6f, col_values=(('tag', 9),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:48.689903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-694ef31e-6f, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:48.695664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-694ef31e-6f, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:48.709356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-694ef31e-6f, col_values=(('other_config', {'net_uuid': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '687'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:48.724969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee86,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:48.725290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: a642f240-21a3-4c54-8d26-c38ff0409d76 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:48.725966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port a642f240-21a3-4c54-8d26-c38ff0409d76 updated. Details: {'device': 'a642f240-21a3-4c54-8d26-c38ff0409d76', 'device_id': 'f3789d4a-963a-496a-91ee-a84328d73cb8', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'a642f240-21a3-4c54-8d26-c38ff0409d76', 'mac_address': 'fa:16:3e:0f:65:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.5'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 00:57:48.727316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a642f240-21, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:48.728063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-a642f240-21, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:48.728718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-a642f240-21, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:48.729296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:48.731521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a642f240-21, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:48.732900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:48.740801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee88,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:48.741791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:297 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.064 Oct 09 00:57:48.742612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:57:48.743104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:57:48.746270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:48.746843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:48.755140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:48.840888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d765c7c-402d-4479-bbbb-266326c7df7e]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:48.841555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:297 - agent port security group processed in 0.164 Oct 09 00:57:48.842711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 694ef31e-6f15-4593-9990-eb27b05a49e8 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:48.843018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for a642f240-21a3-4c54-8d26-c38ff0409d76 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:49.323850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 694ef31e-6f15-4593-9990-eb27b05a49e8 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:57:49.324387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (694ef31e-6f15-4593-9990-eb27b05a49e8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:49.438442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['694ef31e-6f15-4593-9990-eb27b05a49e8', 'a642f240-21a3-4c54-8d26-c38ff0409d76'] and devices down [] completed. Oct 09 00:57:49.439048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:297 - ports processed. Elapsed:0.773 Oct 09 00:57:49.439554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:297 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.773 Oct 09 00:57:50.064695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:49Z,description='Default security group',id=9b1f26ef-7cac-4614-9d12-7e0c153b8843,is_default=True,name='default',project_id='3ffe1ca49c4140ea8b6eecc9d2667b3b',revision_number=1,rules=[SecurityGroupRule(6f128745-b644-4544-a192-edba3d7da87c),SecurityGroupRule(8d0fc24b-2675-4112-bd08-898c6164e2c4),SecurityGroupRule(a84cf2b3-8594-4321-9b34-614f6be43902),SecurityGroupRule(d01e42d9-b728-453d-bb55-7537c03969d7)],shared=False,stateful=True,updated_at=2022-10-09T00:57:49Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.065286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (9b1f26ef-7cac-4614-9d12-7e0c153b8843), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.066194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:49Z,description=,direction='egress',ethertype='IPv4',id=6f128745-b644-4544-a192-edba3d7da87c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ffe1ca49c4140ea8b6eecc9d2667b3b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9b1f26ef-7cac-4614-9d12-7e0c153b8843,updated_at=2022-10-09T00:57:49Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.066727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6f128745-b644-4544-a192-edba3d7da87c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.067288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Security group rule updated ['9b1f26ef-7cac-4614-9d12-7e0c153b8843'] Oct 09 00:57:50.068163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:49Z,description=,direction='ingress',ethertype='IPv4',id=8d0fc24b-2675-4112-bd08-898c6164e2c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ffe1ca49c4140ea8b6eecc9d2667b3b',protocol=,remote_address_group_id=,remote_group_id=9b1f26ef-7cac-4614-9d12-7e0c153b8843,remote_ip_prefix=,revision_number=0,security_group_id=9b1f26ef-7cac-4614-9d12-7e0c153b8843,updated_at=2022-10-09T00:57:49Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.071925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8d0fc24b-2675-4112-bd08-898c6164e2c4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.072667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Security group rule updated ['9b1f26ef-7cac-4614-9d12-7e0c153b8843'] Oct 09 00:57:50.073890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:49Z,description=,direction='ingress',ethertype='IPv6',id=a84cf2b3-8594-4321-9b34-614f6be43902,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ffe1ca49c4140ea8b6eecc9d2667b3b',protocol=,remote_address_group_id=,remote_group_id=9b1f26ef-7cac-4614-9d12-7e0c153b8843,remote_ip_prefix=,revision_number=0,security_group_id=9b1f26ef-7cac-4614-9d12-7e0c153b8843,updated_at=2022-10-09T00:57:49Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.074515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a84cf2b3-8594-4321-9b34-614f6be43902), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.076420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Security group rule updated ['9b1f26ef-7cac-4614-9d12-7e0c153b8843'] Oct 09 00:57:50.077382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:49Z,description=,direction='egress',ethertype='IPv6',id=d01e42d9-b728-453d-bb55-7537c03969d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ffe1ca49c4140ea8b6eecc9d2667b3b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9b1f26ef-7cac-4614-9d12-7e0c153b8843,updated_at=2022-10-09T00:57:49Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.077986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d01e42d9-b728-453d-bb55-7537c03969d7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.078548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cc2391b1-ddc8-4ff6-a04a-266106efcc2e admin admin] Security group rule updated ['9b1f26ef-7cac-4614-9d12-7e0c153b8843'] Oct 09 00:57:50.482273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Resource SecurityGroup deleted: 9b1f26ef-7cac-4614-9d12-7e0c153b8843 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:50.484727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (9b1f26ef-7cac-4614-9d12-7e0c153b8843), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.485298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9b1f26ef-7cac-4614-9d12-7e0c153b8843',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:50.508934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9b1f26ef-7cac-4614-9d12-7e0c153b8843',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:50.509501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Resource SecurityGroupRule deleted: 6f128745-b644-4544-a192-edba3d7da87c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:50.509871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6f128745-b644-4544-a192-edba3d7da87c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.510304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Security group rule updated ['9b1f26ef-7cac-4614-9d12-7e0c153b8843'] Oct 09 00:57:50.510867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Resource SecurityGroupRule deleted: 8d0fc24b-2675-4112-bd08-898c6164e2c4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:50.511437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8d0fc24b-2675-4112-bd08-898c6164e2c4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.511782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Security group rule updated ['9b1f26ef-7cac-4614-9d12-7e0c153b8843'] Oct 09 00:57:50.512260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Resource SecurityGroupRule deleted: a84cf2b3-8594-4321-9b34-614f6be43902 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:50.512607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a84cf2b3-8594-4321-9b34-614f6be43902), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.512925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Security group rule updated ['9b1f26ef-7cac-4614-9d12-7e0c153b8843'] Oct 09 00:57:50.513337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Resource SecurityGroupRule deleted: d01e42d9-b728-453d-bb55-7537c03969d7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:50.513676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d01e42d9-b728-453d-bb55-7537c03969d7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.514039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1935f764-f0f1-4115-aa93-353e28916965 admin admin] Security group rule updated ['9b1f26ef-7cac-4614-9d12-7e0c153b8843'] Oct 09 00:57:50.669000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:298 started Oct 09 00:57:50.674183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=995000000,duration_sec=612,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:50.674892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:50.675527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:298 - starting polling. Elapsed:0.008 Oct 09 00:57:50.678875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.682869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:298 - port information retrieved. Elapsed:0.016 Oct 09 00:57:50.683375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', 'd4998b74-c67b-4a9b-8a8d-658bc5efb89b', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'694ef31e-6f15-4593-9990-eb27b05a49e8'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 00:57:50.684219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '694ef31e-6f15-4593-9990-eb27b05a49e8', 'device_id': 'f3789d4a-963a-496a-91ee-a84328d73cb8', 'network_id': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'port_id': '694ef31e-6f15-4593-9990-eb27b05a49e8', 'mac_address': 'fa:16:3e:d3:3f:32', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3b0167a8-9316-47c8-b78a-93b4c6f720b5', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 00:57:50.688183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 694ef31e-6f15-4593-9990-eb27b05a49e8 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 00:57:50.688769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 694ef31e-6f15-4593-9990-eb27b05a49e8 updated. Details: {'device': '694ef31e-6f15-4593-9990-eb27b05a49e8', 'device_id': 'f3789d4a-963a-496a-91ee-a84328d73cb8', 'network_id': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'port_id': '694ef31e-6f15-4593-9990-eb27b05a49e8', 'mac_address': 'fa:16:3e:d3:3f:32', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 687, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3b0167a8-9316-47c8-b78a-93b4c6f720b5', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 09 00:57:50.690578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-694ef31e-6f, col_values=(('tag', 9),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:50.691273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-694ef31e-6f, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:50.691908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-694ef31e-6f, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:50.692892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:50.694138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-694ef31e-6f, col_values=(('other_config', {'net_uuid': 'db7e2df3-cfef-4dc0-bfd4-74237b8cf94f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '687', 'tag': '9'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 00:57:50.695275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 00:57:50.703155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ee8c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:50.703613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:298 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.020 Oct 09 00:57:50.704200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 00:57:50.704801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 00:57:50.706283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 00:57:50.707295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 00:57:50.712103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 00:57:50.779107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d673546-c110-4b29-a0f1-43ac2af3ab98]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 00:57:50.780134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:298 - agent port security group processed in 0.096 Oct 09 00:57:50.781367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 694ef31e-6f15-4593-9990-eb27b05a49e8 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 00:57:50.819997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:50Z,description='Default security group',id=c351743c-9926-42e1-8b77-e91529fa60a4,is_default=True,name='default',project_id='95f6d79f28744858b8cfe8c8313c2ff2',revision_number=1,rules=[SecurityGroupRule(6710c086-ac74-42eb-ac69-6a0f636195df),SecurityGroupRule(a37fb329-be49-4df6-bf42-a843dc334d89),SecurityGroupRule(b47d8d4a-3a3d-40bd-9916-886fdaa93f46),SecurityGroupRule(ceb2b85d-1865-4ed6-a3a3-e54e20a4e360)],shared=False,stateful=True,updated_at=2022-10-09T00:57:50Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.821045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (c351743c-9926-42e1-8b77-e91529fa60a4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.821729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:50Z,description=,direction='egress',ethertype='IPv4',id=6710c086-ac74-42eb-ac69-6a0f636195df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95f6d79f28744858b8cfe8c8313c2ff2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c351743c-9926-42e1-8b77-e91529fa60a4,updated_at=2022-10-09T00:57:50Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.822098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6710c086-ac74-42eb-ac69-6a0f636195df), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.822443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Security group rule updated ['c351743c-9926-42e1-8b77-e91529fa60a4'] Oct 09 00:57:50.823143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:50Z,description=,direction='ingress',ethertype='IPv6',id=a37fb329-be49-4df6-bf42-a843dc334d89,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95f6d79f28744858b8cfe8c8313c2ff2',protocol=,remote_address_group_id=,remote_group_id=c351743c-9926-42e1-8b77-e91529fa60a4,remote_ip_prefix=,revision_number=0,security_group_id=c351743c-9926-42e1-8b77-e91529fa60a4,updated_at=2022-10-09T00:57:50Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.823501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a37fb329-be49-4df6-bf42-a843dc334d89), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.823867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Security group rule updated ['c351743c-9926-42e1-8b77-e91529fa60a4'] Oct 09 00:57:50.824534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:50Z,description=,direction='ingress',ethertype='IPv4',id=b47d8d4a-3a3d-40bd-9916-886fdaa93f46,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95f6d79f28744858b8cfe8c8313c2ff2',protocol=,remote_address_group_id=,remote_group_id=c351743c-9926-42e1-8b77-e91529fa60a4,remote_ip_prefix=,revision_number=0,security_group_id=c351743c-9926-42e1-8b77-e91529fa60a4,updated_at=2022-10-09T00:57:50Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.825107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b47d8d4a-3a3d-40bd-9916-886fdaa93f46), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.825611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Security group rule updated ['c351743c-9926-42e1-8b77-e91529fa60a4'] Oct 09 00:57:50.826421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:50Z,description=,direction='egress',ethertype='IPv6',id=ceb2b85d-1865-4ed6-a3a3-e54e20a4e360,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95f6d79f28744858b8cfe8c8313c2ff2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c351743c-9926-42e1-8b77-e91529fa60a4,updated_at=2022-10-09T00:57:50Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:50.826940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ceb2b85d-1865-4ed6-a3a3-e54e20a4e360), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:50.828010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-23e651ba-4e57-4b25-8d7c-7f301af3f810 admin admin] Security group rule updated ['c351743c-9926-42e1-8b77-e91529fa60a4'] Oct 09 00:57:50.960553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['694ef31e-6f15-4593-9990-eb27b05a49e8'] and devices down [] completed. Oct 09 00:57:50.960890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:298 - ports processed. Elapsed:0.294 Oct 09 00:57:50.961201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:298 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.294 Oct 09 00:57:51.106732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Resource SecurityGroup deleted: c351743c-9926-42e1-8b77-e91529fa60a4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.107120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (c351743c-9926-42e1-8b77-e91529fa60a4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.108101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c351743c-9926-42e1-8b77-e91529fa60a4',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:51.127624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c351743c-9926-42e1-8b77-e91529fa60a4',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:51.128106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Resource SecurityGroupRule deleted: 6710c086-ac74-42eb-ac69-6a0f636195df {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.131396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6710c086-ac74-42eb-ac69-6a0f636195df), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.131953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Security group rule updated ['c351743c-9926-42e1-8b77-e91529fa60a4'] Oct 09 00:57:51.132455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Resource SecurityGroupRule deleted: a37fb329-be49-4df6-bf42-a843dc334d89 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.132857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a37fb329-be49-4df6-bf42-a843dc334d89), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.133190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Security group rule updated ['c351743c-9926-42e1-8b77-e91529fa60a4'] Oct 09 00:57:51.133695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Resource SecurityGroupRule deleted: b47d8d4a-3a3d-40bd-9916-886fdaa93f46 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.134188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b47d8d4a-3a3d-40bd-9916-886fdaa93f46), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.134536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Security group rule updated ['c351743c-9926-42e1-8b77-e91529fa60a4'] Oct 09 00:57:51.134904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Resource SecurityGroupRule deleted: ceb2b85d-1865-4ed6-a3a3-e54e20a4e360 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.135248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ceb2b85d-1865-4ed6-a3a3-e54e20a4e360), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.135560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ab33f782-1153-40be-a464-fd52f00dd9d1 admin admin] Security group rule updated ['c351743c-9926-42e1-8b77-e91529fa60a4'] Oct 09 00:57:51.725825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:51Z,description='Default security group',id=8d84fb76-2ba7-4d77-b2e2-a99fecad311c,is_default=True,name='default',project_id='a242229ba2ba4d10b765848a9cdd89a5',revision_number=1,rules=[SecurityGroupRule(0e7d40a0-10a1-4019-b421-c4c060df23b5),SecurityGroupRule(4fba5397-f16b-4060-b869-38a10b3e4eb9),SecurityGroupRule(8717292b-3aa7-47f6-8a51-48441a6bf26c),SecurityGroupRule(a283eca4-2f25-4ab1-b823-698c7a9310a8)],shared=False,stateful=True,updated_at=2022-10-09T00:57:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:51.726818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (8d84fb76-2ba7-4d77-b2e2-a99fecad311c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.727463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:51Z,description=,direction='ingress',ethertype='IPv6',id=0e7d40a0-10a1-4019-b421-c4c060df23b5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a242229ba2ba4d10b765848a9cdd89a5',protocol=,remote_address_group_id=,remote_group_id=8d84fb76-2ba7-4d77-b2e2-a99fecad311c,remote_ip_prefix=,revision_number=0,security_group_id=8d84fb76-2ba7-4d77-b2e2-a99fecad311c,updated_at=2022-10-09T00:57:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:51.727858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0e7d40a0-10a1-4019-b421-c4c060df23b5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.728352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Security group rule updated ['8d84fb76-2ba7-4d77-b2e2-a99fecad311c'] Oct 09 00:57:51.729206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:51Z,description=,direction='egress',ethertype='IPv4',id=4fba5397-f16b-4060-b869-38a10b3e4eb9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a242229ba2ba4d10b765848a9cdd89a5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d84fb76-2ba7-4d77-b2e2-a99fecad311c,updated_at=2022-10-09T00:57:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:51.730143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4fba5397-f16b-4060-b869-38a10b3e4eb9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.733202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Security group rule updated ['8d84fb76-2ba7-4d77-b2e2-a99fecad311c'] Oct 09 00:57:51.734043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:51Z,description=,direction='egress',ethertype='IPv6',id=8717292b-3aa7-47f6-8a51-48441a6bf26c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a242229ba2ba4d10b765848a9cdd89a5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d84fb76-2ba7-4d77-b2e2-a99fecad311c,updated_at=2022-10-09T00:57:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:51.734416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8717292b-3aa7-47f6-8a51-48441a6bf26c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.734757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Security group rule updated ['8d84fb76-2ba7-4d77-b2e2-a99fecad311c'] Oct 09 00:57:51.735469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:51Z,description=,direction='ingress',ethertype='IPv4',id=a283eca4-2f25-4ab1-b823-698c7a9310a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a242229ba2ba4d10b765848a9cdd89a5',protocol=,remote_address_group_id=,remote_group_id=8d84fb76-2ba7-4d77-b2e2-a99fecad311c,remote_ip_prefix=,revision_number=0,security_group_id=8d84fb76-2ba7-4d77-b2e2-a99fecad311c,updated_at=2022-10-09T00:57:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:51.735858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a283eca4-2f25-4ab1-b823-698c7a9310a8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.736195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bb7ce234-4d05-4854-86a0-74a6802b0e24 admin admin] Security group rule updated ['8d84fb76-2ba7-4d77-b2e2-a99fecad311c'] Oct 09 00:57:51.883236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Resource SecurityGroup deleted: 8d84fb76-2ba7-4d77-b2e2-a99fecad311c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.883627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (8d84fb76-2ba7-4d77-b2e2-a99fecad311c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.884079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8d84fb76-2ba7-4d77-b2e2-a99fecad311c',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:51.900495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8d84fb76-2ba7-4d77-b2e2-a99fecad311c',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:51.901003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Resource SecurityGroupRule deleted: 0e7d40a0-10a1-4019-b421-c4c060df23b5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.901543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0e7d40a0-10a1-4019-b421-c4c060df23b5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.901877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Security group rule updated ['8d84fb76-2ba7-4d77-b2e2-a99fecad311c'] Oct 09 00:57:51.902260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Resource SecurityGroupRule deleted: 4fba5397-f16b-4060-b869-38a10b3e4eb9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.902598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4fba5397-f16b-4060-b869-38a10b3e4eb9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.903487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Security group rule updated ['8d84fb76-2ba7-4d77-b2e2-a99fecad311c'] Oct 09 00:57:51.903815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Resource SecurityGroupRule deleted: 8717292b-3aa7-47f6-8a51-48441a6bf26c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.904159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8717292b-3aa7-47f6-8a51-48441a6bf26c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.904475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Security group rule updated ['8d84fb76-2ba7-4d77-b2e2-a99fecad311c'] Oct 09 00:57:51.904838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Resource SecurityGroupRule deleted: a283eca4-2f25-4ab1-b823-698c7a9310a8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:51.905176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a283eca4-2f25-4ab1-b823-698c7a9310a8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:51.905483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-50ac8396-cbca-461d-aecf-c6a4de95b3a7 admin admin] Security group rule updated ['8d84fb76-2ba7-4d77-b2e2-a99fecad311c'] Oct 09 00:57:52.668728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:299 started Oct 09 00:57:52.671414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=992000000,duration_sec=614,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:52.672102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:52.672527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:299 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:54.669467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:300 started Oct 09 00:57:54.672204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=993000000,duration_sec=616,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:54.672794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:54.673148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:300 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:56.670799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:301 started Oct 09 00:57:56.673447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=994000000,duration_sec=618,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:56.674119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:56.674551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:301 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:57:57.432150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:57Z,description='Default security group',id=c4952621-4112-4cbc-bd6d-561c460c7b62,is_default=True,name='default',project_id='6e99f83d1032419d9ecc59913e902c54',revision_number=1,rules=[SecurityGroupRule(ab199c7e-eeba-4069-9409-069911e59f78),SecurityGroupRule(c324c749-14f2-475f-add3-e9a7751382f3),SecurityGroupRule(e37b856e-ca85-4485-acd1-8389b78c42c2),SecurityGroupRule(ea537701-b18a-4254-b247-d844c6198062)],shared=False,stateful=True,updated_at=2022-10-09T00:57:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:57.432150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (c4952621-4112-4cbc-bd6d-561c460c7b62), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.433002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:57Z,description=,direction='ingress',ethertype='IPv4',id=ab199c7e-eeba-4069-9409-069911e59f78,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6e99f83d1032419d9ecc59913e902c54',protocol=,remote_address_group_id=,remote_group_id=c4952621-4112-4cbc-bd6d-561c460c7b62,remote_ip_prefix=,revision_number=0,security_group_id=c4952621-4112-4cbc-bd6d-561c460c7b62,updated_at=2022-10-09T00:57:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:57.433351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ab199c7e-eeba-4069-9409-069911e59f78), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.434135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Security group rule updated ['c4952621-4112-4cbc-bd6d-561c460c7b62'] Oct 09 00:57:57.435099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:57Z,description=,direction='egress',ethertype='IPv6',id=c324c749-14f2-475f-add3-e9a7751382f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6e99f83d1032419d9ecc59913e902c54',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4952621-4112-4cbc-bd6d-561c460c7b62,updated_at=2022-10-09T00:57:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:57.435215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c324c749-14f2-475f-add3-e9a7751382f3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.435545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Security group rule updated ['c4952621-4112-4cbc-bd6d-561c460c7b62'] Oct 09 00:57:57.436217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:57Z,description=,direction='egress',ethertype='IPv4',id=e37b856e-ca85-4485-acd1-8389b78c42c2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6e99f83d1032419d9ecc59913e902c54',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4952621-4112-4cbc-bd6d-561c460c7b62,updated_at=2022-10-09T00:57:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:57.436564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e37b856e-ca85-4485-acd1-8389b78c42c2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.436884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Security group rule updated ['c4952621-4112-4cbc-bd6d-561c460c7b62'] Oct 09 00:57:57.437554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:57Z,description=,direction='ingress',ethertype='IPv6',id=ea537701-b18a-4254-b247-d844c6198062,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6e99f83d1032419d9ecc59913e902c54',protocol=,remote_address_group_id=,remote_group_id=c4952621-4112-4cbc-bd6d-561c460c7b62,remote_ip_prefix=,revision_number=0,security_group_id=c4952621-4112-4cbc-bd6d-561c460c7b62,updated_at=2022-10-09T00:57:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:57.437948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ea537701-b18a-4254-b247-d844c6198062), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.438175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2cc42d27-d98f-4858-b967-4b688b5da01e admin admin] Security group rule updated ['c4952621-4112-4cbc-bd6d-561c460c7b62'] Oct 09 00:57:57.631008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Resource SecurityGroup deleted: c4952621-4112-4cbc-bd6d-561c460c7b62 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:57.631528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (c4952621-4112-4cbc-bd6d-561c460c7b62), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.632085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c4952621-4112-4cbc-bd6d-561c460c7b62',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:57.648244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c4952621-4112-4cbc-bd6d-561c460c7b62',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:57.648812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Resource SecurityGroupRule deleted: ab199c7e-eeba-4069-9409-069911e59f78 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:57.649281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ab199c7e-eeba-4069-9409-069911e59f78), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.649707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Security group rule updated ['c4952621-4112-4cbc-bd6d-561c460c7b62'] Oct 09 00:57:57.650259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Resource SecurityGroupRule deleted: c324c749-14f2-475f-add3-e9a7751382f3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:57.650600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c324c749-14f2-475f-add3-e9a7751382f3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.651182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Security group rule updated ['c4952621-4112-4cbc-bd6d-561c460c7b62'] Oct 09 00:57:57.651620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Resource SecurityGroupRule deleted: e37b856e-ca85-4485-acd1-8389b78c42c2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:57.651944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e37b856e-ca85-4485-acd1-8389b78c42c2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.652256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Security group rule updated ['c4952621-4112-4cbc-bd6d-561c460c7b62'] Oct 09 00:57:57.652650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Resource SecurityGroupRule deleted: ea537701-b18a-4254-b247-d844c6198062 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:57.653108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ea537701-b18a-4254-b247-d844c6198062), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:57.653474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-97d6dd39-9442-4a22-9e59-ada01025639d admin admin] Security group rule updated ['c4952621-4112-4cbc-bd6d-561c460c7b62'] Oct 09 00:57:58.671728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:302 started Oct 09 00:57:58.681594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=995000000,duration_sec=620,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:57:58.684331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:57:58.684913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:302 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 00:57:59.225838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:59Z,description='Default security group',id=567fe35a-862c-4303-99be-884195f28be6,is_default=True,name='default',project_id='12ae8ab3a3a64ff6887430aab9669232',revision_number=1,rules=[SecurityGroupRule(7366429b-e7f9-4d22-a5ce-6716fb6ebfc8),SecurityGroupRule(798f34c9-a024-48a1-beb3-d8e7d2ea17ed),SecurityGroupRule(984a8779-3898-4ca7-a9a5-c6338f78c6ed),SecurityGroupRule(c9d1e9d5-0556-41f6-975a-4b4d987bf60b)],shared=False,stateful=True,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.226326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (567fe35a-862c-4303-99be-884195f28be6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.227024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:59Z,description=,direction='ingress',ethertype='IPv6',id=7366429b-e7f9-4d22-a5ce-6716fb6ebfc8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='12ae8ab3a3a64ff6887430aab9669232',protocol=,remote_address_group_id=,remote_group_id=567fe35a-862c-4303-99be-884195f28be6,remote_ip_prefix=,revision_number=0,security_group_id=567fe35a-862c-4303-99be-884195f28be6,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.227455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7366429b-e7f9-4d22-a5ce-6716fb6ebfc8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.227875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Security group rule updated ['567fe35a-862c-4303-99be-884195f28be6'] Oct 09 00:57:59.228621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:59Z,description=,direction='ingress',ethertype='IPv4',id=798f34c9-a024-48a1-beb3-d8e7d2ea17ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='12ae8ab3a3a64ff6887430aab9669232',protocol=,remote_address_group_id=,remote_group_id=567fe35a-862c-4303-99be-884195f28be6,remote_ip_prefix=,revision_number=0,security_group_id=567fe35a-862c-4303-99be-884195f28be6,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.229061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (798f34c9-a024-48a1-beb3-d8e7d2ea17ed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.229460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Security group rule updated ['567fe35a-862c-4303-99be-884195f28be6'] Oct 09 00:57:59.230185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:59Z,description=,direction='egress',ethertype='IPv6',id=984a8779-3898-4ca7-a9a5-c6338f78c6ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='12ae8ab3a3a64ff6887430aab9669232',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=567fe35a-862c-4303-99be-884195f28be6,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.230608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (984a8779-3898-4ca7-a9a5-c6338f78c6ed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.231001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Security group rule updated ['567fe35a-862c-4303-99be-884195f28be6'] Oct 09 00:57:59.231745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:59Z,description=,direction='egress',ethertype='IPv4',id=c9d1e9d5-0556-41f6-975a-4b4d987bf60b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='12ae8ab3a3a64ff6887430aab9669232',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=567fe35a-862c-4303-99be-884195f28be6,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.232195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c9d1e9d5-0556-41f6-975a-4b4d987bf60b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.232597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f0007392-f2b5-4ead-9b63-32d64b3b4d11 admin admin] Security group rule updated ['567fe35a-862c-4303-99be-884195f28be6'] Oct 09 00:57:59.359296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Resource SecurityGroup deleted: 567fe35a-862c-4303-99be-884195f28be6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:59.359762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (567fe35a-862c-4303-99be-884195f28be6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.360321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('567fe35a-862c-4303-99be-884195f28be6',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:57:59.375299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('567fe35a-862c-4303-99be-884195f28be6',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:57:59.375807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Resource SecurityGroupRule deleted: 7366429b-e7f9-4d22-a5ce-6716fb6ebfc8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:59.376249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7366429b-e7f9-4d22-a5ce-6716fb6ebfc8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.376646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Security group rule updated ['567fe35a-862c-4303-99be-884195f28be6'] Oct 09 00:57:59.377063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Resource SecurityGroupRule deleted: 798f34c9-a024-48a1-beb3-d8e7d2ea17ed {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:59.377408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (798f34c9-a024-48a1-beb3-d8e7d2ea17ed), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.377723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Security group rule updated ['567fe35a-862c-4303-99be-884195f28be6'] Oct 09 00:57:59.378087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Resource SecurityGroupRule deleted: 984a8779-3898-4ca7-a9a5-c6338f78c6ed {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:59.378491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (984a8779-3898-4ca7-a9a5-c6338f78c6ed), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.378764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Security group rule updated ['567fe35a-862c-4303-99be-884195f28be6'] Oct 09 00:57:59.379210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Resource SecurityGroupRule deleted: c9d1e9d5-0556-41f6-975a-4b4d987bf60b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:59.379459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c9d1e9d5-0556-41f6-975a-4b4d987bf60b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.379808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2bb4299-6b80-44f0-8904-e6dd71169f13 admin admin] Security group rule updated ['567fe35a-862c-4303-99be-884195f28be6'] Oct 09 00:57:59.821879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:57:59Z,description='Default security group',id=6b48e9b5-1f64-448a-b81c-30860e51f2c8,is_default=True,name='default',project_id='211862bbf0dd4e7092c1c33f6321459c',revision_number=1,rules=[SecurityGroupRule(1c519ea8-bd43-4264-a53c-07fad33d5cae),SecurityGroupRule(63578df5-a599-45af-aefc-1b8d20dc4372),SecurityGroupRule(86ed81db-de20-43a2-ab3e-7398fd8b4514),SecurityGroupRule(a494511c-8b6a-46d3-83fb-a8df19611eeb)],shared=False,stateful=True,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.822636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (6b48e9b5-1f64-448a-b81c-30860e51f2c8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.822967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:59Z,description=,direction='ingress',ethertype='IPv4',id=1c519ea8-bd43-4264-a53c-07fad33d5cae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='211862bbf0dd4e7092c1c33f6321459c',protocol=,remote_address_group_id=,remote_group_id=6b48e9b5-1f64-448a-b81c-30860e51f2c8,remote_ip_prefix=,revision_number=0,security_group_id=6b48e9b5-1f64-448a-b81c-30860e51f2c8,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.823416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1c519ea8-bd43-4264-a53c-07fad33d5cae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.823849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Security group rule updated ['6b48e9b5-1f64-448a-b81c-30860e51f2c8'] Oct 09 00:57:59.827283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:59Z,description=,direction='egress',ethertype='IPv6',id=63578df5-a599-45af-aefc-1b8d20dc4372,normalized_cidr=None,port_range_max=,port_range_min=,project_id='211862bbf0dd4e7092c1c33f6321459c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6b48e9b5-1f64-448a-b81c-30860e51f2c8,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.827777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (63578df5-a599-45af-aefc-1b8d20dc4372), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.828188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Security group rule updated ['6b48e9b5-1f64-448a-b81c-30860e51f2c8'] Oct 09 00:57:59.828939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:59Z,description=,direction='ingress',ethertype='IPv6',id=86ed81db-de20-43a2-ab3e-7398fd8b4514,normalized_cidr=None,port_range_max=,port_range_min=,project_id='211862bbf0dd4e7092c1c33f6321459c',protocol=,remote_address_group_id=,remote_group_id=6b48e9b5-1f64-448a-b81c-30860e51f2c8,remote_ip_prefix=,revision_number=0,security_group_id=6b48e9b5-1f64-448a-b81c-30860e51f2c8,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.830273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (86ed81db-de20-43a2-ab3e-7398fd8b4514), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.830605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Security group rule updated ['6b48e9b5-1f64-448a-b81c-30860e51f2c8'] Oct 09 00:57:59.831817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:57:59Z,description=,direction='egress',ethertype='IPv4',id=a494511c-8b6a-46d3-83fb-a8df19611eeb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='211862bbf0dd4e7092c1c33f6321459c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6b48e9b5-1f64-448a-b81c-30860e51f2c8,updated_at=2022-10-09T00:57:59Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:57:59.832176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a494511c-8b6a-46d3-83fb-a8df19611eeb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.832504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f83f8b5-b607-4c70-a9dd-8049d39d077a admin admin] Security group rule updated ['6b48e9b5-1f64-448a-b81c-30860e51f2c8'] Oct 09 00:57:59.989617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Resource SecurityGroup deleted: 6b48e9b5-1f64-448a-b81c-30860e51f2c8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:57:59.990018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (6b48e9b5-1f64-448a-b81c-30860e51f2c8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:57:59.990478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6b48e9b5-1f64-448a-b81c-30860e51f2c8',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:00.011083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6b48e9b5-1f64-448a-b81c-30860e51f2c8',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:00.020488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Resource SecurityGroupRule deleted: 1c519ea8-bd43-4264-a53c-07fad33d5cae {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:00.020956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1c519ea8-bd43-4264-a53c-07fad33d5cae), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:00.021392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Security group rule updated ['6b48e9b5-1f64-448a-b81c-30860e51f2c8'] Oct 09 00:58:00.022045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Resource SecurityGroupRule deleted: 63578df5-a599-45af-aefc-1b8d20dc4372 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:00.022657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (63578df5-a599-45af-aefc-1b8d20dc4372), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:00.023131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Security group rule updated ['6b48e9b5-1f64-448a-b81c-30860e51f2c8'] Oct 09 00:58:00.023703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Resource SecurityGroupRule deleted: 86ed81db-de20-43a2-ab3e-7398fd8b4514 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:00.024263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (86ed81db-de20-43a2-ab3e-7398fd8b4514), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:00.024832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Security group rule updated ['6b48e9b5-1f64-448a-b81c-30860e51f2c8'] Oct 09 00:58:00.025359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Resource SecurityGroupRule deleted: a494511c-8b6a-46d3-83fb-a8df19611eeb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:00.026021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a494511c-8b6a-46d3-83fb-a8df19611eeb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:00.026568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d9f24e8e-11be-40a6-bb1c-556159ea9e3d admin admin] Security group rule updated ['6b48e9b5-1f64-448a-b81c-30860e51f2c8'] Oct 09 00:58:00.673268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:303 started Oct 09 00:58:00.676982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=997000000,duration_sec=622,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:00.677694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:00.678116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:303 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:58:01.268303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:00Z,description='Default security group',id=71825412-9698-4c96-a949-2dfab85cd77c,is_default=True,name='default',project_id='23d6fc625f854ae4945b67513046d2ed',revision_number=1,rules=[SecurityGroupRule(10286dd1-fd3e-44ab-bcad-0fce849f03d3),SecurityGroupRule(7348a9c1-874b-4818-9f34-64a8b092e9b5),SecurityGroupRule(ae311a13-978a-4b44-8f50-bf1b034c0cf3),SecurityGroupRule(d60b0e38-45e6-4a0d-8a0f-b192fa3f6716)],shared=False,stateful=True,updated_at=2022-10-09T00:58:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:01.269886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (71825412-9698-4c96-a949-2dfab85cd77c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:01.270659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:00Z,description=,direction='egress',ethertype='IPv4',id=10286dd1-fd3e-44ab-bcad-0fce849f03d3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='23d6fc625f854ae4945b67513046d2ed',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=71825412-9698-4c96-a949-2dfab85cd77c,updated_at=2022-10-09T00:58:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:01.271172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (10286dd1-fd3e-44ab-bcad-0fce849f03d3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:01.271858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Security group rule updated ['71825412-9698-4c96-a949-2dfab85cd77c'] Oct 09 00:58:01.273895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:00Z,description=,direction='ingress',ethertype='IPv4',id=7348a9c1-874b-4818-9f34-64a8b092e9b5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='23d6fc625f854ae4945b67513046d2ed',protocol=,remote_address_group_id=,remote_group_id=71825412-9698-4c96-a949-2dfab85cd77c,remote_ip_prefix=,revision_number=0,security_group_id=71825412-9698-4c96-a949-2dfab85cd77c,updated_at=2022-10-09T00:58:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:01.274414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7348a9c1-874b-4818-9f34-64a8b092e9b5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:01.275485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Security group rule updated ['71825412-9698-4c96-a949-2dfab85cd77c'] Oct 09 00:58:01.276542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:00Z,description=,direction='ingress',ethertype='IPv6',id=ae311a13-978a-4b44-8f50-bf1b034c0cf3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='23d6fc625f854ae4945b67513046d2ed',protocol=,remote_address_group_id=,remote_group_id=71825412-9698-4c96-a949-2dfab85cd77c,remote_ip_prefix=,revision_number=0,security_group_id=71825412-9698-4c96-a949-2dfab85cd77c,updated_at=2022-10-09T00:58:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:01.277172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ae311a13-978a-4b44-8f50-bf1b034c0cf3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:01.277801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Security group rule updated ['71825412-9698-4c96-a949-2dfab85cd77c'] Oct 09 00:58:01.278630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:00Z,description=,direction='egress',ethertype='IPv6',id=d60b0e38-45e6-4a0d-8a0f-b192fa3f6716,normalized_cidr=None,port_range_max=,port_range_min=,project_id='23d6fc625f854ae4945b67513046d2ed',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=71825412-9698-4c96-a949-2dfab85cd77c,updated_at=2022-10-09T00:58:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:01.279191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d60b0e38-45e6-4a0d-8a0f-b192fa3f6716), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:01.279740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Security group rule updated ['71825412-9698-4c96-a949-2dfab85cd77c'] Oct 09 00:58:01.425569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:58:01Z,description='',dns_domain=None,id=23909b14-58b7-428e-a577-8f5866763cbf,mtu=1500,name='tempest-VolumesActionsTest-192169332-network',project_id='23d6fc625f854ae4945b67513046d2ed',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(23909b14-58b7-428e-a577-8f5866763cbf),segments=[NetworkSegment(84d982bc-cd16-4341-9cff-07d8ed6cf882)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:58:01Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:01.426053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (23909b14-58b7-428e-a577-8f5866763cbf), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-9cf158a7-72eb-42ca-81f8-119e92f20b4e admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 23909b14-58b7-428e-a577-8f5866763cbf with segmentation id not found. Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:58:01.497842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:58:01.498819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:58:01.498819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:58:01.498819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:58:01.498819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 23909b14-58b7-428e-a577-8f5866763cbf with segmentation id not found. Oct 09 00:58:01.498819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:58:01.709376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3415cf23-fcd1-4e9b-a7dc-7f039144908c admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ecab8f40-c7d7-45f7-91de-3599460dc0b7)],cidr=172.20.0.0/28,created_at=2022-10-09T00:58:01Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=a2cb9013-c740-43a3-81a8-f97fde791afc,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-192169332-subnet',network_id=23909b14-58b7-428e-a577-8f5866763cbf,project_id='23d6fc625f854ae4945b67513046d2ed',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:58:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:01.709750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3415cf23-fcd1-4e9b-a7dc-7f039144908c admin admin] Publish callbacks [] for Subnet (a2cb9013-c740-43a3-81a8-f97fde791afc), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:02.486983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:02Z,description='Default security group',id=43112c85-7f1d-4dfe-8fa5-a2fe77905d1b,is_default=True,name='default',project_id='e1ccdbaa29bd464ba64ad77ff7a00244',revision_number=1,rules=[SecurityGroupRule(08d06545-5c31-450c-b038-e939b1bff8d9),SecurityGroupRule(31e76725-ff30-4f9c-9ef0-81b22e4f2738),SecurityGroupRule(3ca09198-90d9-44c4-b98b-15302a18f6b6),SecurityGroupRule(9030aaba-f919-42d0-95a8-89a1348ebe91)],shared=False,stateful=True,updated_at=2022-10-09T00:58:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:02.488180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (43112c85-7f1d-4dfe-8fa5-a2fe77905d1b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:02.488716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:02Z,description=,direction='ingress',ethertype='IPv4',id=08d06545-5c31-450c-b038-e939b1bff8d9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1ccdbaa29bd464ba64ad77ff7a00244',protocol=,remote_address_group_id=,remote_group_id=43112c85-7f1d-4dfe-8fa5-a2fe77905d1b,remote_ip_prefix=,revision_number=0,security_group_id=43112c85-7f1d-4dfe-8fa5-a2fe77905d1b,updated_at=2022-10-09T00:58:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:02.489072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (08d06545-5c31-450c-b038-e939b1bff8d9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:02.489403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Security group rule updated ['43112c85-7f1d-4dfe-8fa5-a2fe77905d1b'] Oct 09 00:58:02.490066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:02Z,description=,direction='egress',ethertype='IPv4',id=31e76725-ff30-4f9c-9ef0-81b22e4f2738,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1ccdbaa29bd464ba64ad77ff7a00244',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=43112c85-7f1d-4dfe-8fa5-a2fe77905d1b,updated_at=2022-10-09T00:58:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:02.490414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (31e76725-ff30-4f9c-9ef0-81b22e4f2738), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:02.490741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Security group rule updated ['43112c85-7f1d-4dfe-8fa5-a2fe77905d1b'] Oct 09 00:58:02.491410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:02Z,description=,direction='ingress',ethertype='IPv6',id=3ca09198-90d9-44c4-b98b-15302a18f6b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1ccdbaa29bd464ba64ad77ff7a00244',protocol=,remote_address_group_id=,remote_group_id=43112c85-7f1d-4dfe-8fa5-a2fe77905d1b,remote_ip_prefix=,revision_number=0,security_group_id=43112c85-7f1d-4dfe-8fa5-a2fe77905d1b,updated_at=2022-10-09T00:58:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:02.491784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3ca09198-90d9-44c4-b98b-15302a18f6b6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:02.492111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Security group rule updated ['43112c85-7f1d-4dfe-8fa5-a2fe77905d1b'] Oct 09 00:58:02.492769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:02Z,description=,direction='egress',ethertype='IPv6',id=9030aaba-f919-42d0-95a8-89a1348ebe91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1ccdbaa29bd464ba64ad77ff7a00244',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=43112c85-7f1d-4dfe-8fa5-a2fe77905d1b,updated_at=2022-10-09T00:58:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:02.493113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9030aaba-f919-42d0-95a8-89a1348ebe91), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:02.493436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Security group rule updated ['43112c85-7f1d-4dfe-8fa5-a2fe77905d1b'] Oct 09 00:58:02.666652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:58:02Z,description='',dns_domain=None,id=699808b6-1532-46f6-bced-259b6124a56e,mtu=1500,name='tempest-VolumesActionsTest-317967718-network',project_id='e1ccdbaa29bd464ba64ad77ff7a00244',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(699808b6-1532-46f6-bced-259b6124a56e),segments=[NetworkSegment(1f94296c-1550-4a33-979e-bea254bd84d4)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:58:02Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:02.667113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (699808b6-1532-46f6-bced-259b6124a56e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:02.685822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:304 started Oct 09 00:58:02.691695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=9000000,duration_sec=625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:02.691695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:02.691695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:304 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-e054094e-2f9b-43ac-895c-0e6b897e1d3f admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 699808b6-1532-46f6-bced-259b6124a56e with segmentation id not found. Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:58:02.863995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:58:02.865046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:58:02.865046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:58:02.865046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:58:02.865046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 699808b6-1532-46f6-bced-259b6124a56e with segmentation id not found. Oct 09 00:58:02.865046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:58:02.947121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9148257e-cb5a-4f95-854a-4d91d5f5381a admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ea8c1a98-4c86-4f2e-96b5-b870e1d974f8)],cidr=172.20.0.0/28,created_at=2022-10-09T00:58:02Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=7450b5c1-1243-4f9d-976c-728d188a0027,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-317967718-subnet',network_id=699808b6-1532-46f6-bced-259b6124a56e,project_id='e1ccdbaa29bd464ba64ad77ff7a00244',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:58:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:02.947496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9148257e-cb5a-4f95-854a-4d91d5f5381a admin admin] Publish callbacks [] for Subnet (7450b5c1-1243-4f9d-976c-728d188a0027), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:04.686543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:305 started Oct 09 00:58:04.689146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=10000000,duration_sec=627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:04.689713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:04.690074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:305 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:06.687465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:306 started Oct 09 00:58:06.690005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=11000000,duration_sec=629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:06.691158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:06.691521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:306 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:08.690232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:307 started Oct 09 00:58:08.693130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ee9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=13000000,duration_sec=631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:08.698724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:08.699107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:307 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 00:58:10.691476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:308 started Oct 09 00:58:10.693820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eea0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=15000000,duration_sec=633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:10.694375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:10.694719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:308 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:58:12.692740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:309 started Oct 09 00:58:12.695130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eea2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=16000000,duration_sec=635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:12.695993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:12.696202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:309 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:14.692837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:310 started Oct 09 00:58:14.700482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eea4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=16000000,duration_sec=637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:14.701339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:14.701767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:310 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 00:58:16.693346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:311 started Oct 09 00:58:16.696087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eea6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=17000000,duration_sec=639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:16.696862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:16.697314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:311 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:18.581008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:18Z,description='Default security group',id=df1c768d-728a-4e33-b189-45ab7c745f0f,is_default=True,name='default',project_id='bb307f6a86b24a31901293578f3d8e2b',revision_number=1,rules=[SecurityGroupRule(62893c40-b1aa-49a9-a41e-22f66843cc80),SecurityGroupRule(b77b8e8b-d285-4716-ae8b-887ec4db82bd),SecurityGroupRule(b96c8ea0-97cd-43cb-89c5-166716bd282d),SecurityGroupRule(fd995634-e902-4846-9745-d9eb3dc40f92)],shared=False,stateful=True,updated_at=2022-10-09T00:58:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:18.581606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (df1c768d-728a-4e33-b189-45ab7c745f0f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.582438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:18Z,description=,direction='egress',ethertype='IPv6',id=62893c40-b1aa-49a9-a41e-22f66843cc80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb307f6a86b24a31901293578f3d8e2b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=df1c768d-728a-4e33-b189-45ab7c745f0f,updated_at=2022-10-09T00:58:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:18.582813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (62893c40-b1aa-49a9-a41e-22f66843cc80), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.583246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Security group rule updated ['df1c768d-728a-4e33-b189-45ab7c745f0f'] Oct 09 00:58:18.583939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:18Z,description=,direction='egress',ethertype='IPv4',id=b77b8e8b-d285-4716-ae8b-887ec4db82bd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb307f6a86b24a31901293578f3d8e2b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=df1c768d-728a-4e33-b189-45ab7c745f0f,updated_at=2022-10-09T00:58:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:18.584296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b77b8e8b-d285-4716-ae8b-887ec4db82bd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.584707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Security group rule updated ['df1c768d-728a-4e33-b189-45ab7c745f0f'] Oct 09 00:58:18.585368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:18Z,description=,direction='ingress',ethertype='IPv6',id=b96c8ea0-97cd-43cb-89c5-166716bd282d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb307f6a86b24a31901293578f3d8e2b',protocol=,remote_address_group_id=,remote_group_id=df1c768d-728a-4e33-b189-45ab7c745f0f,remote_ip_prefix=,revision_number=0,security_group_id=df1c768d-728a-4e33-b189-45ab7c745f0f,updated_at=2022-10-09T00:58:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:18.585773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b96c8ea0-97cd-43cb-89c5-166716bd282d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.586099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Security group rule updated ['df1c768d-728a-4e33-b189-45ab7c745f0f'] Oct 09 00:58:18.586795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:18Z,description=,direction='ingress',ethertype='IPv4',id=fd995634-e902-4846-9745-d9eb3dc40f92,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb307f6a86b24a31901293578f3d8e2b',protocol=,remote_address_group_id=,remote_group_id=df1c768d-728a-4e33-b189-45ab7c745f0f,remote_ip_prefix=,revision_number=0,security_group_id=df1c768d-728a-4e33-b189-45ab7c745f0f,updated_at=2022-10-09T00:58:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:18.587141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fd995634-e902-4846-9745-d9eb3dc40f92), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.587466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8515d446-ad19-4d97-a6e2-90074f2e71ab admin admin] Security group rule updated ['df1c768d-728a-4e33-b189-45ab7c745f0f'] Oct 09 00:58:18.694281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:312 started Oct 09 00:58:18.696891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eea8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=18000000,duration_sec=641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:18.697491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:18.697869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:312 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:18.718066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Resource SecurityGroup deleted: df1c768d-728a-4e33-b189-45ab7c745f0f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:18.718513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (df1c768d-728a-4e33-b189-45ab7c745f0f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.719034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('df1c768d-728a-4e33-b189-45ab7c745f0f',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:18.732223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('df1c768d-728a-4e33-b189-45ab7c745f0f',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:18.732721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Resource SecurityGroupRule deleted: 62893c40-b1aa-49a9-a41e-22f66843cc80 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:18.733109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (62893c40-b1aa-49a9-a41e-22f66843cc80), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.733476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Security group rule updated ['df1c768d-728a-4e33-b189-45ab7c745f0f'] Oct 09 00:58:18.733812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Resource SecurityGroupRule deleted: b77b8e8b-d285-4716-ae8b-887ec4db82bd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:18.734152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b77b8e8b-d285-4716-ae8b-887ec4db82bd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.734465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Security group rule updated ['df1c768d-728a-4e33-b189-45ab7c745f0f'] Oct 09 00:58:18.734888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Resource SecurityGroupRule deleted: b96c8ea0-97cd-43cb-89c5-166716bd282d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:18.735257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b96c8ea0-97cd-43cb-89c5-166716bd282d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.735620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Security group rule updated ['df1c768d-728a-4e33-b189-45ab7c745f0f'] Oct 09 00:58:18.736044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Resource SecurityGroupRule deleted: fd995634-e902-4846-9745-d9eb3dc40f92 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:18.736310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fd995634-e902-4846-9745-d9eb3dc40f92), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:18.736620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-acdf6126-b219-4dd0-bbe0-c5c2aba27f96 admin admin] Security group rule updated ['df1c768d-728a-4e33-b189-45ab7c745f0f'] Oct 09 00:58:20.695259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:313 started Oct 09 00:58:20.699200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeaa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=20000000,duration_sec=643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:20.699861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:20.700322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:313 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:58:20.845362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fc416516-d745-4aee-ba12-79c513cd39b1 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:20Z,description='tempest-description--1388466846',id=62d755d4-51cf-4ded-af28-c7a0b18fbab7,is_default=False,name='tempest-securitygroup--1657261559',project_id='a7d8e82f58814da6b8c08bfa04955d4c',revision_number=1,rules=[SecurityGroupRule(db5b4d63-daba-465e-ac9e-9ff2ea3eb25d),SecurityGroupRule(f5af4924-89cc-4989-b9ca-dbf47c1434fd)],shared=False,stateful=True,updated_at=2022-10-09T00:58:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:20.845968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fc416516-d745-4aee-ba12-79c513cd39b1 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (62d755d4-51cf-4ded-af28-c7a0b18fbab7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:20.846243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fc416516-d745-4aee-ba12-79c513cd39b1 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:20Z,description=,direction='egress',ethertype='IPv4',id=db5b4d63-daba-465e-ac9e-9ff2ea3eb25d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=62d755d4-51cf-4ded-af28-c7a0b18fbab7,updated_at=2022-10-09T00:58:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:20.846602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fc416516-d745-4aee-ba12-79c513cd39b1 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (db5b4d63-daba-465e-ac9e-9ff2ea3eb25d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:20.846943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fc416516-d745-4aee-ba12-79c513cd39b1 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['62d755d4-51cf-4ded-af28-c7a0b18fbab7'] Oct 09 00:58:20.851775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fc416516-d745-4aee-ba12-79c513cd39b1 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:20Z,description=,direction='egress',ethertype='IPv6',id=f5af4924-89cc-4989-b9ca-dbf47c1434fd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=62d755d4-51cf-4ded-af28-c7a0b18fbab7,updated_at=2022-10-09T00:58:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:20.852802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fc416516-d745-4aee-ba12-79c513cd39b1 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f5af4924-89cc-4989-b9ca-dbf47c1434fd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:20.853385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fc416516-d745-4aee-ba12-79c513cd39b1 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['62d755d4-51cf-4ded-af28-c7a0b18fbab7'] Oct 09 00:58:20.982322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e7135d0f-59c6-45c8-9c02-5231f774de3b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:20Z,description='',direction='ingress',ethertype='IPv4',id=0853d9d5-da1a-4c6b-81d5-c6ef153d5109,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=62d755d4-51cf-4ded-af28-c7a0b18fbab7,updated_at=2022-10-09T00:58:20Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:20.982782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e7135d0f-59c6-45c8-9c02-5231f774de3b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0853d9d5-da1a-4c6b-81d5-c6ef153d5109), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:20.983376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e7135d0f-59c6-45c8-9c02-5231f774de3b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['62d755d4-51cf-4ded-af28-c7a0b18fbab7'] Oct 09 00:58:21.129964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-88daeb73-a6e5-4c36-9240-d668840478a7 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:21Z,description='',direction='ingress',ethertype='IPv4',id=216cfce9-45d3-4c6c-b486-d152a8453f8c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=62d755d4-51cf-4ded-af28-c7a0b18fbab7,updated_at=2022-10-09T00:58:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:21.130350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-88daeb73-a6e5-4c36-9240-d668840478a7 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (216cfce9-45d3-4c6c-b486-d152a8453f8c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:21.130699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-88daeb73-a6e5-4c36-9240-d668840478a7 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['62d755d4-51cf-4ded-af28-c7a0b18fbab7'] Oct 09 00:58:21.574481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e5e32690-6aef-402e-aa38-16bba629f04d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:58:21Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6205ae02-54cf-474a-bd53-eb015052af9b,mac_address=fa:16:3e:66:05:d2,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6205ae02-54cf-474a-bd53-eb015052af9b),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T00:58:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:21.574869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e5e32690-6aef-402e-aa38-16bba629f04d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6205ae02-54cf-474a-bd53-eb015052af9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:22.003419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e5e32690-6aef-402e-aa38-16bba629f04d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port 6205ae02-54cf-474a-bd53-eb015052af9b updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '246e7c31-d455-419e-926b-5219fe1cd55f'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:22.004135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e5e32690-6aef-402e-aa38-16bba629f04d tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6205ae02-54cf-474a-bd53-eb015052af9b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:22.415692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-55d42e04-630a-4d71-94f1-226e966acc7b admin admin] Resource Subnet deleted: a2cb9013-c740-43a3-81a8-f97fde791afc {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:22.416009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-55d42e04-630a-4d71-94f1-226e966acc7b admin admin] Publish callbacks [] for Subnet (a2cb9013-c740-43a3-81a8-f97fde791afc), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:22.696584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:314 started Oct 09 00:58:22.699087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=20000000,duration_sec=645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:22.699765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:22.700158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:314 - starting polling. Elapsed:0.004 Oct 09 00:58:22.702729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:22.706227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:314 - port information retrieved. Elapsed:0.010 Oct 09 00:58:22.706670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:314 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:58:22.861071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d495891c-0312-4621-9d95-5d848b8bb452 admin admin] Resource Network deleted: 23909b14-58b7-428e-a577-8f5866763cbf {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:22.861764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d495891c-0312-4621-9d95-5d848b8bb452 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (23909b14-58b7-428e-a577-8f5866763cbf), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:23.128340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-508c2b33-c553-4e9d-bab2-c620564e03a4 admin admin] Resource Subnet deleted: 7450b5c1-1243-4f9d-976c-728d188a0027 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:23.129041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-508c2b33-c553-4e9d-bab2-c620564e03a4 admin admin] Publish callbacks [] for Subnet (7450b5c1-1243-4f9d-976c-728d188a0027), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:23.462862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e68c4b30-60e5-4763-9767-e040a5fb3848 admin admin] Resource Network deleted: 699808b6-1532-46f6-bced-259b6124a56e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:23.463365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e68c4b30-60e5-4763-9767-e040a5fb3848 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (699808b6-1532-46f6-bced-259b6124a56e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:23.842901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Resource SecurityGroup deleted: 71825412-9698-4c96-a949-2dfab85cd77c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:23.845081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (71825412-9698-4c96-a949-2dfab85cd77c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:23.845692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('71825412-9698-4c96-a949-2dfab85cd77c',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:23.861864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('71825412-9698-4c96-a949-2dfab85cd77c',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:23.862371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Resource SecurityGroupRule deleted: 10286dd1-fd3e-44ab-bcad-0fce849f03d3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:23.863272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (10286dd1-fd3e-44ab-bcad-0fce849f03d3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:23.863630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Security group rule updated ['71825412-9698-4c96-a949-2dfab85cd77c'] Oct 09 00:58:23.864031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Resource SecurityGroupRule deleted: 7348a9c1-874b-4818-9f34-64a8b092e9b5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:23.864379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7348a9c1-874b-4818-9f34-64a8b092e9b5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:23.864697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Security group rule updated ['71825412-9698-4c96-a949-2dfab85cd77c'] Oct 09 00:58:23.865065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Resource SecurityGroupRule deleted: ae311a13-978a-4b44-8f50-bf1b034c0cf3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:23.865405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ae311a13-978a-4b44-8f50-bf1b034c0cf3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:23.865721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Security group rule updated ['71825412-9698-4c96-a949-2dfab85cd77c'] Oct 09 00:58:23.866084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Resource SecurityGroupRule deleted: d60b0e38-45e6-4a0d-8a0f-b192fa3f6716 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:23.866422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d60b0e38-45e6-4a0d-8a0f-b192fa3f6716), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:23.866736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2e6a513c-48df-45ef-91aa-12478c1345af admin admin] Security group rule updated ['71825412-9698-4c96-a949-2dfab85cd77c'] Oct 09 00:58:24.529542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Resource SecurityGroup deleted: 43112c85-7f1d-4dfe-8fa5-a2fe77905d1b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:24.530197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (43112c85-7f1d-4dfe-8fa5-a2fe77905d1b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:24.530657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('43112c85-7f1d-4dfe-8fa5-a2fe77905d1b',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:24.551002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('43112c85-7f1d-4dfe-8fa5-a2fe77905d1b',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:24.551497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Resource SecurityGroupRule deleted: 08d06545-5c31-450c-b038-e939b1bff8d9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:24.551905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (08d06545-5c31-450c-b038-e939b1bff8d9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:24.552243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Security group rule updated ['43112c85-7f1d-4dfe-8fa5-a2fe77905d1b'] Oct 09 00:58:24.552649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Resource SecurityGroupRule deleted: 31e76725-ff30-4f9c-9ef0-81b22e4f2738 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:24.553317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (31e76725-ff30-4f9c-9ef0-81b22e4f2738), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:24.553673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Security group rule updated ['43112c85-7f1d-4dfe-8fa5-a2fe77905d1b'] Oct 09 00:58:24.554202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Resource SecurityGroupRule deleted: 3ca09198-90d9-44c4-b98b-15302a18f6b6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:24.554549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3ca09198-90d9-44c4-b98b-15302a18f6b6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:24.554868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Security group rule updated ['43112c85-7f1d-4dfe-8fa5-a2fe77905d1b'] Oct 09 00:58:24.555238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Resource SecurityGroupRule deleted: 9030aaba-f919-42d0-95a8-89a1348ebe91 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:24.555646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9030aaba-f919-42d0-95a8-89a1348ebe91), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:24.555968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7e56e6bd-9b4f-49c6-8f75-e7af7fca78c9 admin admin] Security group rule updated ['43112c85-7f1d-4dfe-8fa5-a2fe77905d1b'] Oct 09 00:58:24.698241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:315 started Oct 09 00:58:24.701066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=22000000,duration_sec=647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:24.701649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:24.702435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:315 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:26.699208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:316 started Oct 09 00:58:26.701655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=23000000,duration_sec=649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:26.702226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:26.702587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:316 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:28.189182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-52c63aa9-f6d2-40b2-8148-f694b24a8308 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:58:27Z,data_plane_status=None,description='',device_id='9988ceee-fd6b-43f1-ae12-74b98a9f128a',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9f833987-35a7-48c2-8720-3ab67f5287e5,mac_address=fa:16:3e:58:e3:23,name='',network_id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,numa_affinity_policy=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9f833987-35a7-48c2-8720-3ab67f5287e5),security_group_ids=set([62d755d4-51cf-4ded-af28-c7a0b18fbab7]),status='DOWN',updated_at=2022-10-09T00:58:27Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:28.189846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-52c63aa9-f6d2-40b2-8148-f694b24a8308 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9f833987-35a7-48c2-8720-3ab67f5287e5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:28.191167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-52c63aa9-f6d2-40b2-8148-f694b24a8308 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group member updated {'62d755d4-51cf-4ded-af28-c7a0b18fbab7'} Oct 09 00:58:28.700672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:317 started Oct 09 00:58:28.703056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=24000000,duration_sec=651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:28.703696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:28.704031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:317 - starting polling. Elapsed:0.004 Oct 09 00:58:28.707349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:28.710860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:317 - port information retrieved. Elapsed:0.010 Oct 09 00:58:28.711195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:317 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 00:58:28.748912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-afe92ef2-0375-4eb6-84ea-65a143db055e service neutron] Resource Port 9f833987-35a7-48c2-8720-3ab67f5287e5 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=9f833987-35a7-48c2-8720-3ab67f5287e5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=9f833987-35a7-48c2-8720-3ab67f5287e5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:28.749385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-afe92ef2-0375-4eb6-84ea-65a143db055e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9f833987-35a7-48c2-8720-3ab67f5287e5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.032875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f562e6a4-8027-40b8-b42d-4e9e6a55d3b8 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:28Z,description='tempest-description--30337096',id=e9a9d17f-82f7-47af-9567-ad6387a276da,is_default=False,name='tempest-securitygroup--465916780',project_id='f68941040b3049bd9c62e2fc061d94c1',revision_number=1,rules=[SecurityGroupRule(2e5353c6-bbb2-46b6-8cbf-32ab364d1324),SecurityGroupRule(88d2319b-658a-45bb-b777-726420afbccd)],shared=False,stateful=True,updated_at=2022-10-09T00:58:28Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.033260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f562e6a4-8027-40b8-b42d-4e9e6a55d3b8 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (e9a9d17f-82f7-47af-9567-ad6387a276da), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.034062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f562e6a4-8027-40b8-b42d-4e9e6a55d3b8 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:28Z,description=,direction='egress',ethertype='IPv6',id=2e5353c6-bbb2-46b6-8cbf-32ab364d1324,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68941040b3049bd9c62e2fc061d94c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e9a9d17f-82f7-47af-9567-ad6387a276da,updated_at=2022-10-09T00:58:28Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.034733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f562e6a4-8027-40b8-b42d-4e9e6a55d3b8 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2e5353c6-bbb2-46b6-8cbf-32ab364d1324), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.034888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f562e6a4-8027-40b8-b42d-4e9e6a55d3b8 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group rule updated ['e9a9d17f-82f7-47af-9567-ad6387a276da'] Oct 09 00:58:29.035535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f562e6a4-8027-40b8-b42d-4e9e6a55d3b8 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:28Z,description=,direction='egress',ethertype='IPv4',id=88d2319b-658a-45bb-b777-726420afbccd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68941040b3049bd9c62e2fc061d94c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e9a9d17f-82f7-47af-9567-ad6387a276da,updated_at=2022-10-09T00:58:28Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.035913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f562e6a4-8027-40b8-b42d-4e9e6a55d3b8 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (88d2319b-658a-45bb-b777-726420afbccd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.036239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f562e6a4-8027-40b8-b42d-4e9e6a55d3b8 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group rule updated ['e9a9d17f-82f7-47af-9567-ad6387a276da'] Oct 09 00:58:29.283748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0baf7faa-8ba4-4314-8939-d532d3957186 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:29Z,description='',direction='ingress',ethertype='IPv4',id=1c2d3c35-05d4-4dc0-93cb-7526c38958bc,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f68941040b3049bd9c62e2fc061d94c1',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e9a9d17f-82f7-47af-9567-ad6387a276da,updated_at=2022-10-09T00:58:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.285108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0baf7faa-8ba4-4314-8939-d532d3957186 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1c2d3c35-05d4-4dc0-93cb-7526c38958bc), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.285108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0baf7faa-8ba4-4314-8939-d532d3957186 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group rule updated ['e9a9d17f-82f7-47af-9567-ad6387a276da'] Oct 09 00:58:29.368071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-afe92ef2-0375-4eb6-84ea-65a143db055e service neutron] Resource Port 9f833987-35a7-48c2-8720-3ab67f5287e5 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=9f833987-35a7-48c2-8720-3ab67f5287e5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=9f833987-35a7-48c2-8720-3ab67f5287e5,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=9f833987-35a7-48c2-8720-3ab67f5287e5,segment=NetworkSegment(e02957c6-4ac3-44cc-ac85-3fb22cee1088),segment_id=e02957c6-4ac3-44cc-ac85-3fb22cee1088)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:29.368454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-afe92ef2-0375-4eb6-84ea-65a143db055e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9f833987-35a7-48c2-8720-3ab67f5287e5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.549576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-73eef5a0-d961-481d-9269-4b36bab22291 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:29Z,description='',direction='ingress',ethertype='IPv4',id=5dfdbab2-fc0e-45a4-b148-80bb871ce5b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68941040b3049bd9c62e2fc061d94c1',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e9a9d17f-82f7-47af-9567-ad6387a276da,updated_at=2022-10-09T00:58:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.550782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-73eef5a0-d961-481d-9269-4b36bab22291 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5dfdbab2-fc0e-45a4-b148-80bb871ce5b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.551283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-73eef5a0-d961-481d-9269-4b36bab22291 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group rule updated ['e9a9d17f-82f7-47af-9567-ad6387a276da'] Oct 09 00:58:29.882896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:29Z,description='Default security group',id=7b168f70-952f-4a0c-bd87-e6039c4864a2,is_default=True,name='default',project_id='89d50d3addae4862bae5a8c8117896c0',revision_number=1,rules=[SecurityGroupRule(2f4dbead-e250-4c0b-8aa4-809a0d51fe13),SecurityGroupRule(6a64c968-9236-44e0-b7ce-051d31835b2c),SecurityGroupRule(9be96a9c-3d92-4898-b39c-8ce355fe57ba),SecurityGroupRule(cf23cb9a-918d-4928-937e-700e98c48fe2)],shared=False,stateful=True,updated_at=2022-10-09T00:58:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.883536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (7b168f70-952f-4a0c-bd87-e6039c4864a2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.884377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:29Z,description=,direction='egress',ethertype='IPv4',id=2f4dbead-e250-4c0b-8aa4-809a0d51fe13,normalized_cidr=None,port_range_max=,port_range_min=,project_id='89d50d3addae4862bae5a8c8117896c0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7b168f70-952f-4a0c-bd87-e6039c4864a2,updated_at=2022-10-09T00:58:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.884743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2f4dbead-e250-4c0b-8aa4-809a0d51fe13), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.885087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Security group rule updated ['7b168f70-952f-4a0c-bd87-e6039c4864a2'] Oct 09 00:58:29.885779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:29Z,description=,direction='ingress',ethertype='IPv4',id=6a64c968-9236-44e0-b7ce-051d31835b2c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='89d50d3addae4862bae5a8c8117896c0',protocol=,remote_address_group_id=,remote_group_id=7b168f70-952f-4a0c-bd87-e6039c4864a2,remote_ip_prefix=,revision_number=0,security_group_id=7b168f70-952f-4a0c-bd87-e6039c4864a2,updated_at=2022-10-09T00:58:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.886137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6a64c968-9236-44e0-b7ce-051d31835b2c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.886898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Security group rule updated ['7b168f70-952f-4a0c-bd87-e6039c4864a2'] Oct 09 00:58:29.887123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:29Z,description=,direction='egress',ethertype='IPv6',id=9be96a9c-3d92-4898-b39c-8ce355fe57ba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='89d50d3addae4862bae5a8c8117896c0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7b168f70-952f-4a0c-bd87-e6039c4864a2,updated_at=2022-10-09T00:58:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.887482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9be96a9c-3d92-4898-b39c-8ce355fe57ba), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.887847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Security group rule updated ['7b168f70-952f-4a0c-bd87-e6039c4864a2'] Oct 09 00:58:29.888672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:29Z,description=,direction='ingress',ethertype='IPv6',id=cf23cb9a-918d-4928-937e-700e98c48fe2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='89d50d3addae4862bae5a8c8117896c0',protocol=,remote_address_group_id=,remote_group_id=7b168f70-952f-4a0c-bd87-e6039c4864a2,remote_ip_prefix=,revision_number=0,security_group_id=7b168f70-952f-4a0c-bd87-e6039c4864a2,updated_at=2022-10-09T00:58:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:29.889084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (cf23cb9a-918d-4928-937e-700e98c48fe2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:29.889363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9b24d891-4040-4944-8931-09e0d0b8cdf0 admin admin] Security group rule updated ['7b168f70-952f-4a0c-bd87-e6039c4864a2'] Oct 09 00:58:30.396642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Resource SecurityGroup deleted: 7b168f70-952f-4a0c-bd87-e6039c4864a2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:30.397274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (7b168f70-952f-4a0c-bd87-e6039c4864a2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.397533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7b168f70-952f-4a0c-bd87-e6039c4864a2',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:30.412469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7b168f70-952f-4a0c-bd87-e6039c4864a2',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:30.413303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Resource SecurityGroupRule deleted: 2f4dbead-e250-4c0b-8aa4-809a0d51fe13 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:30.413681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2f4dbead-e250-4c0b-8aa4-809a0d51fe13), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.414016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Security group rule updated ['7b168f70-952f-4a0c-bd87-e6039c4864a2'] Oct 09 00:58:30.414425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Resource SecurityGroupRule deleted: 6a64c968-9236-44e0-b7ce-051d31835b2c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:30.414754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6a64c968-9236-44e0-b7ce-051d31835b2c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.415074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Security group rule updated ['7b168f70-952f-4a0c-bd87-e6039c4864a2'] Oct 09 00:58:30.415448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Resource SecurityGroupRule deleted: 9be96a9c-3d92-4898-b39c-8ce355fe57ba {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:30.415823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9be96a9c-3d92-4898-b39c-8ce355fe57ba), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.416144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Security group rule updated ['7b168f70-952f-4a0c-bd87-e6039c4864a2'] Oct 09 00:58:30.416513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Resource SecurityGroupRule deleted: cf23cb9a-918d-4928-937e-700e98c48fe2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:30.416855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (cf23cb9a-918d-4928-937e-700e98c48fe2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.420337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d7af0195-b266-448a-a7dc-36581f2d38a6 admin admin] Security group rule updated ['7b168f70-952f-4a0c-bd87-e6039c4864a2'] Oct 09 00:58:30.606042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-57d13dda-d064-4713-abb0-f07d7a23b792 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:58:30Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=bb19d7a6-5629-4f14-ab7a-ae0bbddba04c,mac_address=fa:16:3e:47:80:9a,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(bb19d7a6-5629-4f14-ab7a-ae0bbddba04c),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T00:58:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:30.606698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-57d13dda-d064-4713-abb0-f07d7a23b792 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bb19d7a6-5629-4f14-ab7a-ae0bbddba04c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.701976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:318 started Oct 09 00:58:30.704815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=26000000,duration_sec=653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:30.705454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:30.705858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:318 - starting polling. Elapsed:0.004 Oct 09 00:58:30.708557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.712674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:318 - port information retrieved. Elapsed:0.011 Oct 09 00:58:30.714730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:318 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 00:58:30.973216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:30Z,description='Default security group',id=f76594a5-6cd4-43c8-b57f-f5aaac426c6b,is_default=True,name='default',project_id='dff161b33ef74fb0bf4d7f5bca33cc8b',revision_number=1,rules=[SecurityGroupRule(26aa6fe0-89b6-41ae-bb65-2be50324b007),SecurityGroupRule(5a587480-ce9e-4f49-871a-5d0f210c9d9c),SecurityGroupRule(8a316abb-19a5-4498-a0c5-5b555e3f96f4),SecurityGroupRule(e684dac8-4482-4d18-a473-93360fb26a4d)],shared=False,stateful=True,updated_at=2022-10-09T00:58:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:30.973811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (f76594a5-6cd4-43c8-b57f-f5aaac426c6b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.974723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:30Z,description=,direction='egress',ethertype='IPv4',id=26aa6fe0-89b6-41ae-bb65-2be50324b007,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dff161b33ef74fb0bf4d7f5bca33cc8b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f76594a5-6cd4-43c8-b57f-f5aaac426c6b,updated_at=2022-10-09T00:58:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:30.975790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (26aa6fe0-89b6-41ae-bb65-2be50324b007), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.976350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Security group rule updated ['f76594a5-6cd4-43c8-b57f-f5aaac426c6b'] Oct 09 00:58:30.977199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:30Z,description=,direction='ingress',ethertype='IPv6',id=5a587480-ce9e-4f49-871a-5d0f210c9d9c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dff161b33ef74fb0bf4d7f5bca33cc8b',protocol=,remote_address_group_id=,remote_group_id=f76594a5-6cd4-43c8-b57f-f5aaac426c6b,remote_ip_prefix=,revision_number=0,security_group_id=f76594a5-6cd4-43c8-b57f-f5aaac426c6b,updated_at=2022-10-09T00:58:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:30.977862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5a587480-ce9e-4f49-871a-5d0f210c9d9c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.978407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Security group rule updated ['f76594a5-6cd4-43c8-b57f-f5aaac426c6b'] Oct 09 00:58:30.979220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:30Z,description=,direction='egress',ethertype='IPv6',id=8a316abb-19a5-4498-a0c5-5b555e3f96f4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dff161b33ef74fb0bf4d7f5bca33cc8b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f76594a5-6cd4-43c8-b57f-f5aaac426c6b,updated_at=2022-10-09T00:58:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:30.979789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8a316abb-19a5-4498-a0c5-5b555e3f96f4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.980407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Security group rule updated ['f76594a5-6cd4-43c8-b57f-f5aaac426c6b'] Oct 09 00:58:30.981329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:30Z,description=,direction='ingress',ethertype='IPv4',id=e684dac8-4482-4d18-a473-93360fb26a4d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dff161b33ef74fb0bf4d7f5bca33cc8b',protocol=,remote_address_group_id=,remote_group_id=f76594a5-6cd4-43c8-b57f-f5aaac426c6b,remote_ip_prefix=,revision_number=0,security_group_id=f76594a5-6cd4-43c8-b57f-f5aaac426c6b,updated_at=2022-10-09T00:58:30Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:30.981907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e684dac8-4482-4d18-a473-93360fb26a4d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:30.982399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-73ca26c3-ab31-46b5-bd8e-70ddf0cfcd8c admin admin] Security group rule updated ['f76594a5-6cd4-43c8-b57f-f5aaac426c6b'] Oct 09 00:58:31.041657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-57d13dda-d064-4713-abb0-f07d7a23b792 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource Port bb19d7a6-5629-4f14-ab7a-ae0bbddba04c updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'fe3bc9d1-0c46-4901-887f-aac4309f1810'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:31.042411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-57d13dda-d064-4713-abb0-f07d7a23b792 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bb19d7a6-5629-4f14-ab7a-ae0bbddba04c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:31.175646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Resource SecurityGroup deleted: f76594a5-6cd4-43c8-b57f-f5aaac426c6b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:31.176337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (f76594a5-6cd4-43c8-b57f-f5aaac426c6b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:31.179387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f76594a5-6cd4-43c8-b57f-f5aaac426c6b',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:31.213364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f76594a5-6cd4-43c8-b57f-f5aaac426c6b',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:31.214004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Resource SecurityGroupRule deleted: 26aa6fe0-89b6-41ae-bb65-2be50324b007 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:31.214477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (26aa6fe0-89b6-41ae-bb65-2be50324b007), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:31.214930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Security group rule updated ['f76594a5-6cd4-43c8-b57f-f5aaac426c6b'] Oct 09 00:58:31.215487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Resource SecurityGroupRule deleted: 5a587480-ce9e-4f49-871a-5d0f210c9d9c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:31.216047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5a587480-ce9e-4f49-871a-5d0f210c9d9c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:31.216447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Security group rule updated ['f76594a5-6cd4-43c8-b57f-f5aaac426c6b'] Oct 09 00:58:31.216912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Resource SecurityGroupRule deleted: 8a316abb-19a5-4498-a0c5-5b555e3f96f4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:31.218977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8a316abb-19a5-4498-a0c5-5b555e3f96f4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:31.219580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Security group rule updated ['f76594a5-6cd4-43c8-b57f-f5aaac426c6b'] Oct 09 00:58:31.220236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Resource SecurityGroupRule deleted: e684dac8-4482-4d18-a473-93360fb26a4d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:31.220802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e684dac8-4482-4d18-a473-93360fb26a4d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:31.221349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ae62eb22-4401-4edb-ba28-216bc34f2219 admin admin] Security group rule updated ['f76594a5-6cd4-43c8-b57f-f5aaac426c6b'] Oct 09 00:58:32.705301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:319 started Oct 09 00:58:32.709133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=29000000,duration_sec=655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:32.709940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:32.710325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:319 - starting polling. Elapsed:0.005 Oct 09 00:58:32.721010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:32.725342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:319 - port information retrieved. Elapsed:0.020 Oct 09 00:58:32.725648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:319 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Oct 09 00:58:33.929602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 9f833987-35a7-48c2-8720-3ab67f5287e5 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:33.929602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9f833987-35a7-48c2-8720-3ab67f5287e5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:34.384043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7d044643-bf24-413b-b7f2-90df7b454d37 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:58:33Z,data_plane_status=None,description='',device_id='841a7957-ee73-4765-a850-406b1e720612',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c0379d91-6e4b-4a6c-895c-fc71a455dbb1,mac_address=fa:16:3e:22:63:10,name='',network_id=51f66c80-6e94-4ac9-ad00-6dd9246260d1,numa_affinity_policy=,project_id='28bc82345ea24b929b66fbcded2b97b7',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c0379d91-6e4b-4a6c-895c-fc71a455dbb1),security_group_ids=set([45da6575-619b-423b-bc04-7f831c564029]),status='DOWN',updated_at=2022-10-09T00:58:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:34.384435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7d044643-bf24-413b-b7f2-90df7b454d37 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c0379d91-6e4b-4a6c-895c-fc71a455dbb1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:34.384894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7d044643-bf24-413b-b7f2-90df7b454d37 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group member updated {'45da6575-619b-423b-bc04-7f831c564029'} Oct 09 00:58:34.706800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:320 started Oct 09 00:58:34.710473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=30000000,duration_sec=657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:34.711310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:34.711907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:320 - starting polling. Elapsed:0.005 Oct 09 00:58:34.715073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:34.734268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:320 - port information retrieved. Elapsed:0.027 Oct 09 00:58:34.734627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:320 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.028 Oct 09 00:58:35.343550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a0b4115e-9500-4b1c-b13e-3160cd83012b service neutron] Resource Port c0379d91-6e4b-4a6c-895c-fc71a455dbb1 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=c0379d91-6e4b-4a6c-895c-fc71a455dbb1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=c0379d91-6e4b-4a6c-895c-fc71a455dbb1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:35.344238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a0b4115e-9500-4b1c-b13e-3160cd83012b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c0379d91-6e4b-4a6c-895c-fc71a455dbb1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:35.933413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a0b4115e-9500-4b1c-b13e-3160cd83012b service neutron] Resource Port c0379d91-6e4b-4a6c-895c-fc71a455dbb1 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c0379d91-6e4b-4a6c-895c-fc71a455dbb1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c0379d91-6e4b-4a6c-895c-fc71a455dbb1,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c0379d91-6e4b-4a6c-895c-fc71a455dbb1,segment=NetworkSegment(9512762e-780c-464c-a567-4995173eb1a6),segment_id=9512762e-780c-464c-a567-4995173eb1a6)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:35.933790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a0b4115e-9500-4b1c-b13e-3160cd83012b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c0379d91-6e4b-4a6c-895c-fc71a455dbb1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:36.160105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-99d14058-ca40-4fb1-ba97-7a653461bc5a tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:58:35Z,data_plane_status=None,description='',device_id='50224067-d3e0-4567-bc63-31ace3a211c6',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=af11de25-9b71-43af-8ce0-051a32ec945c,mac_address=fa:16:3e:57:1b:8a,name='',network_id=dd937102-41e7-4629-a161-cb0fb39a0995,numa_affinity_policy=,project_id='f68941040b3049bd9c62e2fc061d94c1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(af11de25-9b71-43af-8ce0-051a32ec945c),security_group_ids=set([e9a9d17f-82f7-47af-9567-ad6387a276da]),status='DOWN',updated_at=2022-10-09T00:58:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:36.160105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-99d14058-ca40-4fb1-ba97-7a653461bc5a tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (af11de25-9b71-43af-8ce0-051a32ec945c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:36.161539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-99d14058-ca40-4fb1-ba97-7a653461bc5a tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group member updated {'e9a9d17f-82f7-47af-9567-ad6387a276da'} Oct 09 00:58:36.708129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:321 started Oct 09 00:58:36.710460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=31000000,duration_sec=659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:36.711029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:36.711367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:321 - starting polling. Elapsed:0.003 Oct 09 00:58:36.713977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:36.717419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:321 - port information retrieved. Elapsed:0.009 Oct 09 00:58:36.717753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:321 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:58:38.414974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 9f833987-35a7-48c2-8720-3ab67f5287e5 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:38.416339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (9f833987-35a7-48c2-8720-3ab67f5287e5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:38.708669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:322 started Oct 09 00:58:38.711252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eebc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=32000000,duration_sec=661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:38.711846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:38.712178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:322 - starting polling. Elapsed:0.004 Oct 09 00:58:38.716746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:38.723145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:322 - port information retrieved. Elapsed:0.015 Oct 09 00:58:38.723488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:322 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 09 00:58:39.014608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-10a421f7-067d-4eb8-9988-3f70680883b3 service neutron] Resource Port af11de25-9b71-43af-8ce0-051a32ec945c updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=af11de25-9b71-43af-8ce0-051a32ec945c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=af11de25-9b71-43af-8ce0-051a32ec945c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:39.015120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-10a421f7-067d-4eb8-9988-3f70680883b3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (af11de25-9b71-43af-8ce0-051a32ec945c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:39.344119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-10a421f7-067d-4eb8-9988-3f70680883b3 service neutron] Resource Port af11de25-9b71-43af-8ce0-051a32ec945c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=af11de25-9b71-43af-8ce0-051a32ec945c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=af11de25-9b71-43af-8ce0-051a32ec945c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=af11de25-9b71-43af-8ce0-051a32ec945c,segment=NetworkSegment(8baf8725-752c-48bf-80b5-a9b2d3636b8e),segment_id=8baf8725-752c-48bf-80b5-a9b2d3636b8e)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:39.344511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-10a421f7-067d-4eb8-9988-3f70680883b3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (af11de25-9b71-43af-8ce0-051a32ec945c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:40.709983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:323 started Oct 09 00:58:40.712586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eebe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=33000000,duration_sec=663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:40.713231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:40.713635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:323 - starting polling. Elapsed:0.004 Oct 09 00:58:40.716469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:40.720149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:323 - port information retrieved. Elapsed:0.010 Oct 09 00:58:40.720562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:323 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 00:58:42.711356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:324 started Oct 09 00:58:42.714679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eec0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=35000000,duration_sec=665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:42.715515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:42.715905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:324 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 00:58:43.154494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:42Z,description='Default security group',id=be809291-78f1-4e1f-b988-f98be85abb51,is_default=True,name='default',project_id='41cc12d5923847858268ee2c8be05164',revision_number=1,rules=[SecurityGroupRule(3df3e03c-9ce4-45f2-b1fb-472f05247584),SecurityGroupRule(7297b389-acfa-4592-8b91-315e0b20ca59),SecurityGroupRule(de054cc8-8dc7-431d-a08f-c39b476e3e23),SecurityGroupRule(e9a419a0-8f96-493a-80be-b902b9d11a36)],shared=False,stateful=True,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.155525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (be809291-78f1-4e1f-b988-f98be85abb51), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.156309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:43Z,description=,direction='ingress',ethertype='IPv6',id=3df3e03c-9ce4-45f2-b1fb-472f05247584,normalized_cidr=None,port_range_max=,port_range_min=,project_id='41cc12d5923847858268ee2c8be05164',protocol=,remote_address_group_id=,remote_group_id=be809291-78f1-4e1f-b988-f98be85abb51,remote_ip_prefix=,revision_number=0,security_group_id=be809291-78f1-4e1f-b988-f98be85abb51,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.156772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3df3e03c-9ce4-45f2-b1fb-472f05247584), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.157757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Security group rule updated ['be809291-78f1-4e1f-b988-f98be85abb51'] Oct 09 00:58:43.158753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:43Z,description=,direction='egress',ethertype='IPv6',id=7297b389-acfa-4592-8b91-315e0b20ca59,normalized_cidr=None,port_range_max=,port_range_min=,project_id='41cc12d5923847858268ee2c8be05164',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=be809291-78f1-4e1f-b988-f98be85abb51,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.159212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7297b389-acfa-4592-8b91-315e0b20ca59), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.159681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Security group rule updated ['be809291-78f1-4e1f-b988-f98be85abb51'] Oct 09 00:58:43.160448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:43Z,description=,direction='ingress',ethertype='IPv4',id=de054cc8-8dc7-431d-a08f-c39b476e3e23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='41cc12d5923847858268ee2c8be05164',protocol=,remote_address_group_id=,remote_group_id=be809291-78f1-4e1f-b988-f98be85abb51,remote_ip_prefix=,revision_number=0,security_group_id=be809291-78f1-4e1f-b988-f98be85abb51,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.160904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (de054cc8-8dc7-431d-a08f-c39b476e3e23), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.161503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Security group rule updated ['be809291-78f1-4e1f-b988-f98be85abb51'] Oct 09 00:58:43.162198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:43Z,description=,direction='egress',ethertype='IPv4',id=e9a419a0-8f96-493a-80be-b902b9d11a36,normalized_cidr=None,port_range_max=,port_range_min=,project_id='41cc12d5923847858268ee2c8be05164',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=be809291-78f1-4e1f-b988-f98be85abb51,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.162649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e9a419a0-8f96-493a-80be-b902b9d11a36), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.163071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9479e205-7e25-4cec-953a-e59964b065b8 admin admin] Security group rule updated ['be809291-78f1-4e1f-b988-f98be85abb51'] Oct 09 00:58:43.290634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Resource SecurityGroup deleted: be809291-78f1-4e1f-b988-f98be85abb51 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.291091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (be809291-78f1-4e1f-b988-f98be85abb51), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.291631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('be809291-78f1-4e1f-b988-f98be85abb51',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:43.311629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('be809291-78f1-4e1f-b988-f98be85abb51',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:43.312822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Resource SecurityGroupRule deleted: 3df3e03c-9ce4-45f2-b1fb-472f05247584 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.313201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3df3e03c-9ce4-45f2-b1fb-472f05247584), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.313566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Security group rule updated ['be809291-78f1-4e1f-b988-f98be85abb51'] Oct 09 00:58:43.315231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Resource SecurityGroupRule deleted: 7297b389-acfa-4592-8b91-315e0b20ca59 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.315805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7297b389-acfa-4592-8b91-315e0b20ca59), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.316138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Security group rule updated ['be809291-78f1-4e1f-b988-f98be85abb51'] Oct 09 00:58:43.316628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Resource SecurityGroupRule deleted: de054cc8-8dc7-431d-a08f-c39b476e3e23 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.317330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (de054cc8-8dc7-431d-a08f-c39b476e3e23), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.317640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Security group rule updated ['be809291-78f1-4e1f-b988-f98be85abb51'] Oct 09 00:58:43.318393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Resource SecurityGroupRule deleted: e9a419a0-8f96-493a-80be-b902b9d11a36 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.318742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e9a419a0-8f96-493a-80be-b902b9d11a36), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.319111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-981f9713-8bce-4000-94b4-dc5db956b5dd admin admin] Security group rule updated ['be809291-78f1-4e1f-b988-f98be85abb51'] Oct 09 00:58:43.751453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:43Z,description='Default security group',id=de682ffc-28a0-4f33-9b52-da62f3741ce6,is_default=True,name='default',project_id='15814fc60c8c40188bbce5f0ce50db10',revision_number=1,rules=[SecurityGroupRule(27b06575-83a1-407c-a5ac-335a7547385c),SecurityGroupRule(75afe6a6-4602-4d86-9421-2405a1e8b92a),SecurityGroupRule(e6c0e7b9-52fe-44c6-b781-5235b737fff9),SecurityGroupRule(e71def10-0b7c-41fe-aae8-a1a37378b405)],shared=False,stateful=True,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.752723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (de682ffc-28a0-4f33-9b52-da62f3741ce6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.752994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:43Z,description=,direction='ingress',ethertype='IPv4',id=27b06575-83a1-407c-a5ac-335a7547385c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15814fc60c8c40188bbce5f0ce50db10',protocol=,remote_address_group_id=,remote_group_id=de682ffc-28a0-4f33-9b52-da62f3741ce6,remote_ip_prefix=,revision_number=0,security_group_id=de682ffc-28a0-4f33-9b52-da62f3741ce6,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.753354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (27b06575-83a1-407c-a5ac-335a7547385c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.753688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Security group rule updated ['de682ffc-28a0-4f33-9b52-da62f3741ce6'] Oct 09 00:58:43.754357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:43Z,description=,direction='egress',ethertype='IPv4',id=75afe6a6-4602-4d86-9421-2405a1e8b92a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15814fc60c8c40188bbce5f0ce50db10',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de682ffc-28a0-4f33-9b52-da62f3741ce6,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.754709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (75afe6a6-4602-4d86-9421-2405a1e8b92a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.755037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Security group rule updated ['de682ffc-28a0-4f33-9b52-da62f3741ce6'] Oct 09 00:58:43.755718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:43Z,description=,direction='egress',ethertype='IPv6',id=e6c0e7b9-52fe-44c6-b781-5235b737fff9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15814fc60c8c40188bbce5f0ce50db10',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de682ffc-28a0-4f33-9b52-da62f3741ce6,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.756071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e6c0e7b9-52fe-44c6-b781-5235b737fff9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.756397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Security group rule updated ['de682ffc-28a0-4f33-9b52-da62f3741ce6'] Oct 09 00:58:43.757056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:43Z,description=,direction='ingress',ethertype='IPv6',id=e71def10-0b7c-41fe-aae8-a1a37378b405,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15814fc60c8c40188bbce5f0ce50db10',protocol=,remote_address_group_id=,remote_group_id=de682ffc-28a0-4f33-9b52-da62f3741ce6,remote_ip_prefix=,revision_number=0,security_group_id=de682ffc-28a0-4f33-9b52-da62f3741ce6,updated_at=2022-10-09T00:58:43Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:43.757406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e71def10-0b7c-41fe-aae8-a1a37378b405), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.757730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f96daae1-5799-472b-8161-f9cbf1abe6e5 admin admin] Security group rule updated ['de682ffc-28a0-4f33-9b52-da62f3741ce6'] Oct 09 00:58:43.923037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Resource SecurityGroup deleted: de682ffc-28a0-4f33-9b52-da62f3741ce6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.923888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (de682ffc-28a0-4f33-9b52-da62f3741ce6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.925512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('de682ffc-28a0-4f33-9b52-da62f3741ce6',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:43.944439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('de682ffc-28a0-4f33-9b52-da62f3741ce6',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:43.945223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Resource SecurityGroupRule deleted: 27b06575-83a1-407c-a5ac-335a7547385c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.946346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (27b06575-83a1-407c-a5ac-335a7547385c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.947060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Security group rule updated ['de682ffc-28a0-4f33-9b52-da62f3741ce6'] Oct 09 00:58:43.948123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Resource SecurityGroupRule deleted: 75afe6a6-4602-4d86-9421-2405a1e8b92a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.948478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (75afe6a6-4602-4d86-9421-2405a1e8b92a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.948831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Security group rule updated ['de682ffc-28a0-4f33-9b52-da62f3741ce6'] Oct 09 00:58:43.949205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Resource SecurityGroupRule deleted: e6c0e7b9-52fe-44c6-b781-5235b737fff9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.949823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e6c0e7b9-52fe-44c6-b781-5235b737fff9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.949956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Security group rule updated ['de682ffc-28a0-4f33-9b52-da62f3741ce6'] Oct 09 00:58:43.950211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Resource SecurityGroupRule deleted: e71def10-0b7c-41fe-aae8-a1a37378b405 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:43.951048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e71def10-0b7c-41fe-aae8-a1a37378b405), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:43.951374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a9c83549-e855-4144-8b71-851263f268dd admin admin] Security group rule updated ['de682ffc-28a0-4f33-9b52-da62f3741ce6'] Oct 09 00:58:44.481762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:44Z,description='Default security group',id=324a3796-a6df-4000-a669-8c1af99aa906,is_default=True,name='default',project_id='855bbf7d882d4e88a30ff3b1d83dd4af',revision_number=1,rules=[SecurityGroupRule(49000455-1bd5-4c8b-9791-39b9ae7a840c),SecurityGroupRule(a9800738-068f-4b6e-975f-f9c016578576),SecurityGroupRule(e158f1ee-eb1d-4c6d-9c04-361ff7ddb1c6),SecurityGroupRule(eabe539a-8da4-4d27-8c86-562deccd487d)],shared=False,stateful=True,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.482142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (324a3796-a6df-4000-a669-8c1af99aa906), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.482818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:44Z,description=,direction='ingress',ethertype='IPv4',id=49000455-1bd5-4c8b-9791-39b9ae7a840c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='855bbf7d882d4e88a30ff3b1d83dd4af',protocol=,remote_address_group_id=,remote_group_id=324a3796-a6df-4000-a669-8c1af99aa906,remote_ip_prefix=,revision_number=0,security_group_id=324a3796-a6df-4000-a669-8c1af99aa906,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.483129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (49000455-1bd5-4c8b-9791-39b9ae7a840c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.483864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Security group rule updated ['324a3796-a6df-4000-a669-8c1af99aa906'] Oct 09 00:58:44.484718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:44Z,description=,direction='ingress',ethertype='IPv6',id=a9800738-068f-4b6e-975f-f9c016578576,normalized_cidr=None,port_range_max=,port_range_min=,project_id='855bbf7d882d4e88a30ff3b1d83dd4af',protocol=,remote_address_group_id=,remote_group_id=324a3796-a6df-4000-a669-8c1af99aa906,remote_ip_prefix=,revision_number=0,security_group_id=324a3796-a6df-4000-a669-8c1af99aa906,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.485330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a9800738-068f-4b6e-975f-f9c016578576), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.485839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Security group rule updated ['324a3796-a6df-4000-a669-8c1af99aa906'] Oct 09 00:58:44.486836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:44Z,description=,direction='egress',ethertype='IPv6',id=e158f1ee-eb1d-4c6d-9c04-361ff7ddb1c6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='855bbf7d882d4e88a30ff3b1d83dd4af',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=324a3796-a6df-4000-a669-8c1af99aa906,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.487586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e158f1ee-eb1d-4c6d-9c04-361ff7ddb1c6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.488289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Security group rule updated ['324a3796-a6df-4000-a669-8c1af99aa906'] Oct 09 00:58:44.489290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:44Z,description=,direction='egress',ethertype='IPv4',id=eabe539a-8da4-4d27-8c86-562deccd487d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='855bbf7d882d4e88a30ff3b1d83dd4af',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=324a3796-a6df-4000-a669-8c1af99aa906,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.489895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (eabe539a-8da4-4d27-8c86-562deccd487d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.490669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0dd639b5-e33a-4877-a569-e798ae54f202 admin admin] Security group rule updated ['324a3796-a6df-4000-a669-8c1af99aa906'] Oct 09 00:58:44.509737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port af11de25-9b71-43af-8ce0-051a32ec945c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:44.510220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (af11de25-9b71-43af-8ce0-051a32ec945c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.547219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:44Z,description='Default security group',id=772dfd5b-ae4e-45eb-983d-a2444602b4ee,is_default=True,name='default',project_id='508281ed1de64e0ebaecd337b7d039f2',revision_number=1,rules=[SecurityGroupRule(a31c28ea-302a-437c-81dd-c83c6e394f25),SecurityGroupRule(ab7992fb-cf02-41bd-87c1-6c316fbd4860),SecurityGroupRule(d574620b-1830-4f38-ba3d-1d548dc20bed),SecurityGroupRule(eeebd943-4b6d-449a-8acc-2fb103b9be57)],shared=False,stateful=True,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.547709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (772dfd5b-ae4e-45eb-983d-a2444602b4ee), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.548433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:44Z,description=,direction='ingress',ethertype='IPv6',id=a31c28ea-302a-437c-81dd-c83c6e394f25,normalized_cidr=None,port_range_max=,port_range_min=,project_id='508281ed1de64e0ebaecd337b7d039f2',protocol=,remote_address_group_id=,remote_group_id=772dfd5b-ae4e-45eb-983d-a2444602b4ee,remote_ip_prefix=,revision_number=0,security_group_id=772dfd5b-ae4e-45eb-983d-a2444602b4ee,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.548882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a31c28ea-302a-437c-81dd-c83c6e394f25), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.549236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Security group rule updated ['772dfd5b-ae4e-45eb-983d-a2444602b4ee'] Oct 09 00:58:44.550043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:44Z,description=,direction='egress',ethertype='IPv6',id=ab7992fb-cf02-41bd-87c1-6c316fbd4860,normalized_cidr=None,port_range_max=,port_range_min=,project_id='508281ed1de64e0ebaecd337b7d039f2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=772dfd5b-ae4e-45eb-983d-a2444602b4ee,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.550455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ab7992fb-cf02-41bd-87c1-6c316fbd4860), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.550848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Security group rule updated ['772dfd5b-ae4e-45eb-983d-a2444602b4ee'] Oct 09 00:58:44.551558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:44Z,description=,direction='egress',ethertype='IPv4',id=d574620b-1830-4f38-ba3d-1d548dc20bed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='508281ed1de64e0ebaecd337b7d039f2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=772dfd5b-ae4e-45eb-983d-a2444602b4ee,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.551948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d574620b-1830-4f38-ba3d-1d548dc20bed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.552277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Security group rule updated ['772dfd5b-ae4e-45eb-983d-a2444602b4ee'] Oct 09 00:58:44.552907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:44Z,description=,direction='ingress',ethertype='IPv4',id=eeebd943-4b6d-449a-8acc-2fb103b9be57,normalized_cidr=None,port_range_max=,port_range_min=,project_id='508281ed1de64e0ebaecd337b7d039f2',protocol=,remote_address_group_id=,remote_group_id=772dfd5b-ae4e-45eb-983d-a2444602b4ee,remote_ip_prefix=,revision_number=0,security_group_id=772dfd5b-ae4e-45eb-983d-a2444602b4ee,updated_at=2022-10-09T00:58:44Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:44.553256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (eeebd943-4b6d-449a-8acc-2fb103b9be57), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.553575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d2ba8ac8-6f47-4b71-b229-08466e6ea983 admin admin] Security group rule updated ['772dfd5b-ae4e-45eb-983d-a2444602b4ee'] Oct 09 00:58:44.712538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:325 started Oct 09 00:58:44.718169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eec2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=38000000,duration_sec=667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:44.719115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:44.719471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:325 - starting polling. Elapsed:0.007 Oct 09 00:58:44.722584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.726064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:325 - port information retrieved. Elapsed:0.014 Oct 09 00:58:44.726551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:325 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 09 00:58:44.745283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Resource SecurityGroup deleted: 324a3796-a6df-4000-a669-8c1af99aa906 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.745871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (324a3796-a6df-4000-a669-8c1af99aa906), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.746318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('324a3796-a6df-4000-a669-8c1af99aa906',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:44.758543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Resource SecurityGroup deleted: 772dfd5b-ae4e-45eb-983d-a2444602b4ee {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.759168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (772dfd5b-ae4e-45eb-983d-a2444602b4ee), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.759567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('772dfd5b-ae4e-45eb-983d-a2444602b4ee',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:44.766490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('324a3796-a6df-4000-a669-8c1af99aa906',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:44.767290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Resource SecurityGroupRule deleted: 49000455-1bd5-4c8b-9791-39b9ae7a840c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.767682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (49000455-1bd5-4c8b-9791-39b9ae7a840c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.768012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Security group rule updated ['324a3796-a6df-4000-a669-8c1af99aa906'] Oct 09 00:58:44.768396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Resource SecurityGroupRule deleted: a9800738-068f-4b6e-975f-f9c016578576 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.768742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a9800738-068f-4b6e-975f-f9c016578576), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.769103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Security group rule updated ['324a3796-a6df-4000-a669-8c1af99aa906'] Oct 09 00:58:44.770274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Resource SecurityGroupRule deleted: e158f1ee-eb1d-4c6d-9c04-361ff7ddb1c6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.770723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e158f1ee-eb1d-4c6d-9c04-361ff7ddb1c6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.771043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Security group rule updated ['324a3796-a6df-4000-a669-8c1af99aa906'] Oct 09 00:58:44.771543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Resource SecurityGroupRule deleted: eabe539a-8da4-4d27-8c86-562deccd487d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.771884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (eabe539a-8da4-4d27-8c86-562deccd487d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.772198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-675a41f3-8e6d-4144-b434-8fd295fcaa1a admin admin] Security group rule updated ['324a3796-a6df-4000-a669-8c1af99aa906'] Oct 09 00:58:44.776308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('772dfd5b-ae4e-45eb-983d-a2444602b4ee',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:44.776780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Resource SecurityGroupRule deleted: a31c28ea-302a-437c-81dd-c83c6e394f25 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.777132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a31c28ea-302a-437c-81dd-c83c6e394f25), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.777465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Security group rule updated ['772dfd5b-ae4e-45eb-983d-a2444602b4ee'] Oct 09 00:58:44.777840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Resource SecurityGroupRule deleted: ab7992fb-cf02-41bd-87c1-6c316fbd4860 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.778212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ab7992fb-cf02-41bd-87c1-6c316fbd4860), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.778530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Security group rule updated ['772dfd5b-ae4e-45eb-983d-a2444602b4ee'] Oct 09 00:58:44.779063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Resource SecurityGroupRule deleted: d574620b-1830-4f38-ba3d-1d548dc20bed {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.779407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d574620b-1830-4f38-ba3d-1d548dc20bed), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.779884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Security group rule updated ['772dfd5b-ae4e-45eb-983d-a2444602b4ee'] Oct 09 00:58:44.780786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Resource SecurityGroupRule deleted: eeebd943-4b6d-449a-8acc-2fb103b9be57 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:44.781175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (eeebd943-4b6d-449a-8acc-2fb103b9be57), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:44.781493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dc2f0972-a526-4589-bc6a-b62153b1b4e8 admin admin] Security group rule updated ['772dfd5b-ae4e-45eb-983d-a2444602b4ee'] Oct 09 00:58:45.824766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:45Z,description='Default security group',id=2b5900ad-4eae-41f0-90e9-7084729c73b2,is_default=True,name='default',project_id='5edae5583d2e4a4688bef23f3a14eda4',revision_number=1,rules=[SecurityGroupRule(126d3766-435f-4f11-bd8d-e7d49dd5ef19),SecurityGroupRule(1e8254dc-d8f4-42ba-bddf-0b3a0b2fd410),SecurityGroupRule(1f1164dc-b33c-4703-b9fa-409f172d9452),SecurityGroupRule(7c2b86ca-906b-42bc-bbbd-6dad0994e33d)],shared=False,stateful=True,updated_at=2022-10-09T00:58:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:45.826045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (2b5900ad-4eae-41f0-90e9-7084729c73b2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:45.827687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:45Z,description=,direction='egress',ethertype='IPv6',id=126d3766-435f-4f11-bd8d-e7d49dd5ef19,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5edae5583d2e4a4688bef23f3a14eda4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b5900ad-4eae-41f0-90e9-7084729c73b2,updated_at=2022-10-09T00:58:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:45.829706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (126d3766-435f-4f11-bd8d-e7d49dd5ef19), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:45.831295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Security group rule updated ['2b5900ad-4eae-41f0-90e9-7084729c73b2'] Oct 09 00:58:45.832546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:45Z,description=,direction='egress',ethertype='IPv4',id=1e8254dc-d8f4-42ba-bddf-0b3a0b2fd410,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5edae5583d2e4a4688bef23f3a14eda4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b5900ad-4eae-41f0-90e9-7084729c73b2,updated_at=2022-10-09T00:58:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:45.833302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1e8254dc-d8f4-42ba-bddf-0b3a0b2fd410), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:45.833847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Security group rule updated ['2b5900ad-4eae-41f0-90e9-7084729c73b2'] Oct 09 00:58:45.835144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:45Z,description=,direction='ingress',ethertype='IPv6',id=1f1164dc-b33c-4703-b9fa-409f172d9452,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5edae5583d2e4a4688bef23f3a14eda4',protocol=,remote_address_group_id=,remote_group_id=2b5900ad-4eae-41f0-90e9-7084729c73b2,remote_ip_prefix=,revision_number=0,security_group_id=2b5900ad-4eae-41f0-90e9-7084729c73b2,updated_at=2022-10-09T00:58:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:45.836040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1f1164dc-b33c-4703-b9fa-409f172d9452), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:45.836441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Security group rule updated ['2b5900ad-4eae-41f0-90e9-7084729c73b2'] Oct 09 00:58:45.838058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:45Z,description=,direction='ingress',ethertype='IPv4',id=7c2b86ca-906b-42bc-bbbd-6dad0994e33d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5edae5583d2e4a4688bef23f3a14eda4',protocol=,remote_address_group_id=,remote_group_id=2b5900ad-4eae-41f0-90e9-7084729c73b2,remote_ip_prefix=,revision_number=0,security_group_id=2b5900ad-4eae-41f0-90e9-7084729c73b2,updated_at=2022-10-09T00:58:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:45.838733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7c2b86ca-906b-42bc-bbbd-6dad0994e33d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:45.839126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Security group rule updated ['2b5900ad-4eae-41f0-90e9-7084729c73b2'] Oct 09 00:58:46.222004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T00:58:45Z,description='',dns_domain=None,id=c27214a2-3f39-42ec-9d84-0333462c2425,mtu=1500,name='tempest-VolumesActionsTest-1892733199-network',project_id='5edae5583d2e4a4688bef23f3a14eda4',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(c27214a2-3f39-42ec-9d84-0333462c2425),segments=[NetworkSegment(42afef76-a35f-4630-81f8-284fedf7e403)],shared=False,status='ACTIVE',updated_at=2022-10-09T00:58:45Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:46.222855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (c27214a2-3f39-42ec-9d84-0333462c2425), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.259527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:46Z,description='Default security group',id=decad5ff-905f-45c5-9a2f-a26431c0937f,is_default=True,name='default',project_id='03feb5df12294d1291aaabcec61c9150',revision_number=1,rules=[SecurityGroupRule(0b1dbf42-548b-4d28-b9b3-084cd14d98ca),SecurityGroupRule(178bfa2f-8358-4c06-a6f4-ee61ccbaaebd),SecurityGroupRule(26936893-fb3f-45c3-93ea-3b7e375460ae),SecurityGroupRule(7e475e95-0120-474f-8046-b49d5e8a4a39)],shared=False,stateful=True,updated_at=2022-10-09T00:58:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:46.260716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (decad5ff-905f-45c5-9a2f-a26431c0937f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.261454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:46Z,description=,direction='egress',ethertype='IPv6',id=0b1dbf42-548b-4d28-b9b3-084cd14d98ca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03feb5df12294d1291aaabcec61c9150',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=decad5ff-905f-45c5-9a2f-a26431c0937f,updated_at=2022-10-09T00:58:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:46.262101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0b1dbf42-548b-4d28-b9b3-084cd14d98ca), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.262401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Security group rule updated ['decad5ff-905f-45c5-9a2f-a26431c0937f'] Oct 09 00:58:46.263427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:46Z,description=,direction='egress',ethertype='IPv4',id=178bfa2f-8358-4c06-a6f4-ee61ccbaaebd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03feb5df12294d1291aaabcec61c9150',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=decad5ff-905f-45c5-9a2f-a26431c0937f,updated_at=2022-10-09T00:58:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:46.263996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (178bfa2f-8358-4c06-a6f4-ee61ccbaaebd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.264802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Security group rule updated ['decad5ff-905f-45c5-9a2f-a26431c0937f'] Oct 09 00:58:46.266039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:46Z,description=,direction='ingress',ethertype='IPv4',id=26936893-fb3f-45c3-93ea-3b7e375460ae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03feb5df12294d1291aaabcec61c9150',protocol=,remote_address_group_id=,remote_group_id=decad5ff-905f-45c5-9a2f-a26431c0937f,remote_ip_prefix=,revision_number=0,security_group_id=decad5ff-905f-45c5-9a2f-a26431c0937f,updated_at=2022-10-09T00:58:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:46.267247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (26936893-fb3f-45c3-93ea-3b7e375460ae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.269250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Security group rule updated ['decad5ff-905f-45c5-9a2f-a26431c0937f'] Oct 09 00:58:46.271474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:46Z,description=,direction='ingress',ethertype='IPv6',id=7e475e95-0120-474f-8046-b49d5e8a4a39,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03feb5df12294d1291aaabcec61c9150',protocol=,remote_address_group_id=,remote_group_id=decad5ff-905f-45c5-9a2f-a26431c0937f,remote_ip_prefix=,revision_number=0,security_group_id=decad5ff-905f-45c5-9a2f-a26431c0937f,updated_at=2022-10-09T00:58:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:46.273151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7e475e95-0120-474f-8046-b49d5e8a4a39), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.273901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e82eb1fc-19ea-4469-a125-6855bf82ac7c admin admin] Security group rule updated ['decad5ff-905f-45c5-9a2f-a26431c0937f'] Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-0f0867ec-8889-477a-8a2a-fd467d905813 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network c27214a2-3f39-42ec-9d84-0333462c2425 with segmentation id not found. Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 00:58:46.330981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 00:58:46.332092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 00:58:46.332092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 00:58:46.332092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 00:58:46.332092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network c27214a2-3f39-42ec-9d84-0333462c2425 with segmentation id not found. Oct 09 00:58:46.332092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 00:58:46.384536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Resource SecurityGroup deleted: decad5ff-905f-45c5-9a2f-a26431c0937f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:46.385159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (decad5ff-905f-45c5-9a2f-a26431c0937f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.385877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('decad5ff-905f-45c5-9a2f-a26431c0937f',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:46.425862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('decad5ff-905f-45c5-9a2f-a26431c0937f',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:46.426472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Resource SecurityGroupRule deleted: 0b1dbf42-548b-4d28-b9b3-084cd14d98ca {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:46.427021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0b1dbf42-548b-4d28-b9b3-084cd14d98ca), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.429597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Security group rule updated ['decad5ff-905f-45c5-9a2f-a26431c0937f'] Oct 09 00:58:46.430323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Resource SecurityGroupRule deleted: 178bfa2f-8358-4c06-a6f4-ee61ccbaaebd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:46.430924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (178bfa2f-8358-4c06-a6f4-ee61ccbaaebd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.431558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Security group rule updated ['decad5ff-905f-45c5-9a2f-a26431c0937f'] Oct 09 00:58:46.432155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Resource SecurityGroupRule deleted: 26936893-fb3f-45c3-93ea-3b7e375460ae {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:46.432721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (26936893-fb3f-45c3-93ea-3b7e375460ae), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.433347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Security group rule updated ['decad5ff-905f-45c5-9a2f-a26431c0937f'] Oct 09 00:58:46.434506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Resource SecurityGroupRule deleted: 7e475e95-0120-474f-8046-b49d5e8a4a39 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:46.435140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7e475e95-0120-474f-8046-b49d5e8a4a39), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.435893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-bd3f00fa-cf90-4806-8ba1-36bca4f5274b admin admin] Security group rule updated ['decad5ff-905f-45c5-9a2f-a26431c0937f'] Oct 09 00:58:46.563699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port af11de25-9b71-43af-8ce0-051a32ec945c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:58:46.564259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (af11de25-9b71-43af-8ce0-051a32ec945c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.599801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-91f03a11-e792-4d7d-9803-7acd481a2335 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(d646df9f-40e2-418f-aaed-ea9880e0a00f)],cidr=172.20.0.0/28,created_at=2022-10-09T00:58:46Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=f493090a-f183-4394-a1a6-e9dd89363581,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-1892733199-subnet',network_id=c27214a2-3f39-42ec-9d84-0333462c2425,project_id='5edae5583d2e4a4688bef23f3a14eda4',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T00:58:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:46.600636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-91f03a11-e792-4d7d-9803-7acd481a2335 admin admin] Publish callbacks [] for Subnet (f493090a-f183-4394-a1a6-e9dd89363581), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.713539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:326 started Oct 09 00:58:46.717548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eec4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=38000000,duration_sec=669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:46.718496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:46.719099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:326 - starting polling. Elapsed:0.006 Oct 09 00:58:46.723755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:46.728761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:326 - port information retrieved. Elapsed:0.015 Oct 09 00:58:46.729396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:326 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 09 00:58:48.715052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:327 started Oct 09 00:58:48.717829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eec6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=38000000,duration_sec=671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:48.718425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:48.718780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:327 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:50.715813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:328 started Oct 09 00:58:50.718229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eec8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=39000000,duration_sec=673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:50.718781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:50.719132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:328 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:51.212639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:58:51Z,description='Default security group',id=3944470a-1402-47d5-993c-98aeeb52121b,is_default=True,name='default',project_id='ebbbad64bcf24f6c9667d7a5282a0f00',revision_number=1,rules=[SecurityGroupRule(3ed14263-63eb-4cb0-9261-945ce3221183),SecurityGroupRule(5783c6d9-6a8c-494f-88e2-db6100a74d7e),SecurityGroupRule(680d2fb4-8c7a-492c-9998-0a6fda4e6284),SecurityGroupRule(ab7c679d-b29f-495e-80e2-855ad3b47a3a)],shared=False,stateful=True,updated_at=2022-10-09T00:58:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:51.213028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (3944470a-1402-47d5-993c-98aeeb52121b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.213690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:51Z,description=,direction='egress',ethertype='IPv4',id=3ed14263-63eb-4cb0-9261-945ce3221183,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebbbad64bcf24f6c9667d7a5282a0f00',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3944470a-1402-47d5-993c-98aeeb52121b,updated_at=2022-10-09T00:58:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:51.214053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3ed14263-63eb-4cb0-9261-945ce3221183), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.214396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Security group rule updated ['3944470a-1402-47d5-993c-98aeeb52121b'] Oct 09 00:58:51.215075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:51Z,description=,direction='egress',ethertype='IPv6',id=5783c6d9-6a8c-494f-88e2-db6100a74d7e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebbbad64bcf24f6c9667d7a5282a0f00',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3944470a-1402-47d5-993c-98aeeb52121b,updated_at=2022-10-09T00:58:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:51.215429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5783c6d9-6a8c-494f-88e2-db6100a74d7e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.215786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Security group rule updated ['3944470a-1402-47d5-993c-98aeeb52121b'] Oct 09 00:58:51.216456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:51Z,description=,direction='ingress',ethertype='IPv4',id=680d2fb4-8c7a-492c-9998-0a6fda4e6284,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebbbad64bcf24f6c9667d7a5282a0f00',protocol=,remote_address_group_id=,remote_group_id=3944470a-1402-47d5-993c-98aeeb52121b,remote_ip_prefix=,revision_number=0,security_group_id=3944470a-1402-47d5-993c-98aeeb52121b,updated_at=2022-10-09T00:58:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:51.216812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (680d2fb4-8c7a-492c-9998-0a6fda4e6284), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.217140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Security group rule updated ['3944470a-1402-47d5-993c-98aeeb52121b'] Oct 09 00:58:51.217803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:58:51Z,description=,direction='ingress',ethertype='IPv6',id=ab7c679d-b29f-495e-80e2-855ad3b47a3a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebbbad64bcf24f6c9667d7a5282a0f00',protocol=,remote_address_group_id=,remote_group_id=3944470a-1402-47d5-993c-98aeeb52121b,remote_ip_prefix=,revision_number=0,security_group_id=3944470a-1402-47d5-993c-98aeeb52121b,updated_at=2022-10-09T00:58:51Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:58:51.218154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ab7c679d-b29f-495e-80e2-855ad3b47a3a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.218508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9b7e314e-e9fe-4ad9-b639-f843f2b65278 admin admin] Security group rule updated ['3944470a-1402-47d5-993c-98aeeb52121b'] Oct 09 00:58:51.418771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Resource SecurityGroup deleted: 3944470a-1402-47d5-993c-98aeeb52121b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:51.419380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (3944470a-1402-47d5-993c-98aeeb52121b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.419871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3944470a-1402-47d5-993c-98aeeb52121b',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:58:51.433844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3944470a-1402-47d5-993c-98aeeb52121b',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:58:51.434368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Resource SecurityGroupRule deleted: 3ed14263-63eb-4cb0-9261-945ce3221183 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:51.434742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3ed14263-63eb-4cb0-9261-945ce3221183), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.435094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Security group rule updated ['3944470a-1402-47d5-993c-98aeeb52121b'] Oct 09 00:58:51.435546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Resource SecurityGroupRule deleted: 5783c6d9-6a8c-494f-88e2-db6100a74d7e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:51.435893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5783c6d9-6a8c-494f-88e2-db6100a74d7e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.436223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Security group rule updated ['3944470a-1402-47d5-993c-98aeeb52121b'] Oct 09 00:58:51.436715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Resource SecurityGroupRule deleted: 680d2fb4-8c7a-492c-9998-0a6fda4e6284 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:51.437061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (680d2fb4-8c7a-492c-9998-0a6fda4e6284), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.437381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Security group rule updated ['3944470a-1402-47d5-993c-98aeeb52121b'] Oct 09 00:58:51.437751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Resource SecurityGroupRule deleted: ab7c679d-b29f-495e-80e2-855ad3b47a3a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:58:51.438143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ab7c679d-b29f-495e-80e2-855ad3b47a3a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:58:51.438653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8ac043d8-32a5-48b0-930c-ea509140daa8 admin admin] Security group rule updated ['3944470a-1402-47d5-993c-98aeeb52121b'] Oct 09 00:58:52.716495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:329 started Oct 09 00:58:52.719069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=40000000,duration_sec=675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:52.719660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:52.720535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:329 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:54.717498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:330 started Oct 09 00:58:54.720640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eecc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=41000000,duration_sec=677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:54.721229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:54.721579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:330 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:56.718116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:331 started Oct 09 00:58:56.720568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eece,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=41000000,duration_sec=679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:56.721129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:56.721479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:331 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:58:58.719231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:332 started Oct 09 00:58:58.722107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eed0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=43000000,duration_sec=681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:58:58.722665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:58:58.723019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:332 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:59:00.525257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port c0379d91-6e4b-4a6c-895c-fc71a455dbb1 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:00.525911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c0379d91-6e4b-4a6c-895c-fc71a455dbb1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:00.720579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:333 started Oct 09 00:59:00.723368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eed2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=44000000,duration_sec=683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:00.724799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:00.725035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:333 - starting polling. Elapsed:0.005 Oct 09 00:59:00.728072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:00.732508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:333 - port information retrieved. Elapsed:0.012 Oct 09 00:59:00.732852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:333 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 09 00:59:00.990862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1d1323ae-3411-4538-a006-8b67cf17d97d tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:59:00Z,data_plane_status=None,description='',device_id='f748f5a5-4a7a-48c7-8790-a5c7ed797db7',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d05ad078-2684-4d21-8255-efa3f61a8cb4,mac_address=fa:16:3e:24:ec:a8,name='',network_id=c27214a2-3f39-42ec-9d84-0333462c2425,numa_affinity_policy=,project_id='5edae5583d2e4a4688bef23f3a14eda4',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d05ad078-2684-4d21-8255-efa3f61a8cb4),security_group_ids=set([2b5900ad-4eae-41f0-90e9-7084729c73b2]),status='DOWN',updated_at=2022-10-09T00:59:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:00.991506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1d1323ae-3411-4538-a006-8b67cf17d97d tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d05ad078-2684-4d21-8255-efa3f61a8cb4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:00.992815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1d1323ae-3411-4538-a006-8b67cf17d97d tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Security group member updated {'2b5900ad-4eae-41f0-90e9-7084729c73b2'} Oct 09 00:59:01.851967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4d26b5a6-f1e3-4bb3-87f9-3d709458488c service neutron] Resource Port d05ad078-2684-4d21-8255-efa3f61a8cb4 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=d05ad078-2684-4d21-8255-efa3f61a8cb4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=d05ad078-2684-4d21-8255-efa3f61a8cb4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:01.852513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4d26b5a6-f1e3-4bb3-87f9-3d709458488c service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d05ad078-2684-4d21-8255-efa3f61a8cb4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:02.557201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4d26b5a6-f1e3-4bb3-87f9-3d709458488c service neutron] Resource Port d05ad078-2684-4d21-8255-efa3f61a8cb4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=d05ad078-2684-4d21-8255-efa3f61a8cb4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=d05ad078-2684-4d21-8255-efa3f61a8cb4,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=d05ad078-2684-4d21-8255-efa3f61a8cb4,segment=NetworkSegment(42afef76-a35f-4630-81f8-284fedf7e403),segment_id=42afef76-a35f-4630-81f8-284fedf7e403)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:02.558070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4d26b5a6-f1e3-4bb3-87f9-3d709458488c service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d05ad078-2684-4d21-8255-efa3f61a8cb4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:02.566255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port c0379d91-6e4b-4a6c-895c-fc71a455dbb1 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:02.566629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c0379d91-6e4b-4a6c-895c-fc71a455dbb1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:02.722033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:334 started Oct 09 00:59:02.724475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eed4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=45000000,duration_sec=685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:02.725096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:02.725428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:334 - starting polling. Elapsed:0.004 Oct 09 00:59:02.727955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:02.731339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:334 - port information retrieved. Elapsed:0.009 Oct 09 00:59:02.731691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:334 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:04.562678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port d05ad078-2684-4d21-8255-efa3f61a8cb4 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:04.563277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d05ad078-2684-4d21-8255-efa3f61a8cb4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:04.722467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:335 started Oct 09 00:59:04.724827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eed6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=46000000,duration_sec=687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:04.725387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:04.725716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:335 - starting polling. Elapsed:0.003 Oct 09 00:59:04.728319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:04.731772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:335 - port information retrieved. Elapsed:0.009 Oct 09 00:59:04.732102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:335 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:06.559070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port d05ad078-2684-4d21-8255-efa3f61a8cb4 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:06.559666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d05ad078-2684-4d21-8255-efa3f61a8cb4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:06.723773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:336 started Oct 09 00:59:06.726295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eed8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=47000000,duration_sec=689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:06.726868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:06.727201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:336 - starting polling. Elapsed:0.004 Oct 09 00:59:06.729805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:06.733251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:336 - port information retrieved. Elapsed:0.010 Oct 09 00:59:06.733580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:336 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:07.722836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1af17d03-a9bf-469e-946e-b31aac3406dd tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:59:07Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7de0dd97-55b5-4e6a-820d-3c84d30f92c4,mac_address=fa:16:3e:ef:09:00,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7de0dd97-55b5-4e6a-820d-3c84d30f92c4),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T00:59:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:07.723465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1af17d03-a9bf-469e-946e-b31aac3406dd tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (7de0dd97-55b5-4e6a-820d-3c84d30f92c4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:08.631747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1af17d03-a9bf-469e-946e-b31aac3406dd tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port 7de0dd97-55b5-4e6a-820d-3c84d30f92c4 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'bc37e80b-a8bb-4236-bb63-7fa03a647bd4'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:08.632123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1af17d03-a9bf-469e-946e-b31aac3406dd tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (7de0dd97-55b5-4e6a-820d-3c84d30f92c4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:08.724308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:337 started Oct 09 00:59:08.726769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=48000000,duration_sec=691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:08.727331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:08.727690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:337 - starting polling. Elapsed:0.004 Oct 09 00:59:08.730215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:08.733685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:337 - port information retrieved. Elapsed:0.010 Oct 09 00:59:08.734014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:337 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:10.725410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:338 started Oct 09 00:59:10.727850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eedc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=49000000,duration_sec=693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:10.728412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:10.728761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:338 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:59:12.726248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:339 started Oct 09 00:59:12.728955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eede,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=49000000,duration_sec=695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:12.729519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:12.729893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:339 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:59:13.105324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-33f7e2a6-21d3-4134-848f-b7009ada2d66 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Resource Port deleted: d05ad078-2684-4d21-8255-efa3f61a8cb4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:13.105883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-33f7e2a6-21d3-4134-848f-b7009ada2d66 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (d05ad078-2684-4d21-8255-efa3f61a8cb4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:13.106307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-33f7e2a6-21d3-4134-848f-b7009ada2d66 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Security group member updated {'2b5900ad-4eae-41f0-90e9-7084729c73b2'} Oct 09 00:59:14.727089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:340 started Oct 09 00:59:14.729611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eee0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=50000000,duration_sec=697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:14.730168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:14.730501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:340 - starting polling. Elapsed:0.004 Oct 09 00:59:14.733066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:14.735247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port d05ad078-2684-4d21-8255-efa3f61a8cb4 not present in bridge br-int Oct 09 00:59:14.735585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 00:59:14.735894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['d05ad078-2684-4d21-8255-efa3f61a8cb4'] Oct 09 00:59:14.736257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port d05ad078-2684-4d21-8255-efa3f61a8cb4 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 00:59:14.739677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:340 - port information retrieved. Elapsed:0.013 Oct 09 00:59:14.740013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:340 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 00:59:16.716770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1962e6f8-2606-4e99-948c-283851524506 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:59:16Z,data_plane_status=None,description='',device_id='bade374f-83da-4ade-adaf-6f27f725883a',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4d6dd279-c688-428d-9c66-ec3efbf54fe7,mac_address=fa:16:3e:dc:0b:a7,name='',network_id=c27214a2-3f39-42ec-9d84-0333462c2425,numa_affinity_policy=,project_id='5edae5583d2e4a4688bef23f3a14eda4',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4d6dd279-c688-428d-9c66-ec3efbf54fe7),security_group_ids=set([2b5900ad-4eae-41f0-90e9-7084729c73b2]),status='DOWN',updated_at=2022-10-09T00:59:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:16.717372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1962e6f8-2606-4e99-948c-283851524506 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4d6dd279-c688-428d-9c66-ec3efbf54fe7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:16.717597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1962e6f8-2606-4e99-948c-283851524506 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Security group member updated {'2b5900ad-4eae-41f0-90e9-7084729c73b2'} Oct 09 00:59:16.727437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:341 started Oct 09 00:59:16.729820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eee2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=51000000,duration_sec=699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:16.730378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:16.730712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:341 - starting polling. Elapsed:0.003 Oct 09 00:59:16.733286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:16.736729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:341 - port information retrieved. Elapsed:0.009 Oct 09 00:59:16.737064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:341 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:17.426784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b0fb64b3-4a6f-46cd-a0d9-689c47ca7252 service neutron] Resource Port 4d6dd279-c688-428d-9c66-ec3efbf54fe7 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=4d6dd279-c688-428d-9c66-ec3efbf54fe7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=4d6dd279-c688-428d-9c66-ec3efbf54fe7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:17.427171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b0fb64b3-4a6f-46cd-a0d9-689c47ca7252 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4d6dd279-c688-428d-9c66-ec3efbf54fe7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:17.692941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b0fb64b3-4a6f-46cd-a0d9-689c47ca7252 service neutron] Resource Port 4d6dd279-c688-428d-9c66-ec3efbf54fe7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=4d6dd279-c688-428d-9c66-ec3efbf54fe7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=4d6dd279-c688-428d-9c66-ec3efbf54fe7,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4d6dd279-c688-428d-9c66-ec3efbf54fe7,segment=NetworkSegment(42afef76-a35f-4630-81f8-284fedf7e403),segment_id=42afef76-a35f-4630-81f8-284fedf7e403)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:17.693328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b0fb64b3-4a6f-46cd-a0d9-689c47ca7252 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4d6dd279-c688-428d-9c66-ec3efbf54fe7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:18.728840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:342 started Oct 09 00:59:18.731255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eee4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=52000000,duration_sec=701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:18.731837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:18.732165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:342 - starting polling. Elapsed:0.003 Oct 09 00:59:18.734755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:18.738787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:342 - port information retrieved. Elapsed:0.010 Oct 09 00:59:18.739113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:342 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:20.730218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:343 started Oct 09 00:59:20.732617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eee6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=54000000,duration_sec=703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:20.733197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:20.733547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:343 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:59:22.690762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 4d6dd279-c688-428d-9c66-ec3efbf54fe7 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:22.691458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4d6dd279-c688-428d-9c66-ec3efbf54fe7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:22.730917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:344 started Oct 09 00:59:22.733173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eee8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=54000000,duration_sec=705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:22.733928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:22.734254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:344 - starting polling. Elapsed:0.003 Oct 09 00:59:22.737397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:22.740822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:344 - port information retrieved. Elapsed:0.010 Oct 09 00:59:22.741148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:344 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:24.712321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 4d6dd279-c688-428d-9c66-ec3efbf54fe7 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:24.712912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4d6dd279-c688-428d-9c66-ec3efbf54fe7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:24.734102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:345 started Oct 09 00:59:24.736600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=58000000,duration_sec=707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:24.737271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:24.737736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:345 - starting polling. Elapsed:0.004 Oct 09 00:59:24.740377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:24.743893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:345 - port information retrieved. Elapsed:0.010 Oct 09 00:59:24.744211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:345 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:26.735191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:346 started Oct 09 00:59:26.737482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=58000000,duration_sec=709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:26.738047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:26.738397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:346 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 00:59:28.736292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:347 started Oct 09 00:59:28.741516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eeee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=60000000,duration_sec=711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:28.742080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:28.742427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:347 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:59:30.736957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:348 started Oct 09 00:59:30.739377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eef0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=60000000,duration_sec=713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:30.740068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:30.740476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:348 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:59:32.738323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:349 started Oct 09 00:59:32.741161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eef2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=61000000,duration_sec=715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:32.742062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:32.742447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:349 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:59:32.875773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-05849cf2-120c-4575-8df5-4f8330c17102 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Resource Port deleted: 4d6dd279-c688-428d-9c66-ec3efbf54fe7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:32.876774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-05849cf2-120c-4575-8df5-4f8330c17102 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (4d6dd279-c688-428d-9c66-ec3efbf54fe7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:32.877187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-05849cf2-120c-4575-8df5-4f8330c17102 tempest-VolumesActionsTest-427535189 tempest-VolumesActionsTest-427535189-project] Security group member updated {'2b5900ad-4eae-41f0-90e9-7084729c73b2'} Oct 09 00:59:33.042533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-32d1a670-5421-4c9d-9611-37ffb27505d2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port deleted: 9f833987-35a7-48c2-8720-3ab67f5287e5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:33.042911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-32d1a670-5421-4c9d-9611-37ffb27505d2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (9f833987-35a7-48c2-8720-3ab67f5287e5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:33.043466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-32d1a670-5421-4c9d-9611-37ffb27505d2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group member updated {'62d755d4-51cf-4ded-af28-c7a0b18fbab7'} Oct 09 00:59:34.739395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:350 started Oct 09 00:59:34.741945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eef4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=63000000,duration_sec=717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:34.742464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:34.742794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:350 - starting polling. Elapsed:0.004 Oct 09 00:59:34.745342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:34.747065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 9f833987-35a7-48c2-8720-3ab67f5287e5 not present in bridge br-int Oct 09 00:59:34.747387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 00:59:34.749028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 4d6dd279-c688-428d-9c66-ec3efbf54fe7 not present in bridge br-int Oct 09 00:59:34.749328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 00:59:34.749764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['4d6dd279-c688-428d-9c66-ec3efbf54fe7', '9f833987-35a7-48c2-8720-3ab67f5287e5'] Oct 09 00:59:34.750294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 4d6dd279-c688-428d-9c66-ec3efbf54fe7 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 00:59:34.750680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 9f833987-35a7-48c2-8720-3ab67f5287e5 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 00:59:34.754285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:350 - port information retrieved. Elapsed:0.015 Oct 09 00:59:34.754571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:350 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 09 00:59:35.564255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroup deleted: 62d755d4-51cf-4ded-af28-c7a0b18fbab7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:35.564655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (62d755d4-51cf-4ded-af28-c7a0b18fbab7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:35.565165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('62d755d4-51cf-4ded-af28-c7a0b18fbab7',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:59:35.589693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('62d755d4-51cf-4ded-af28-c7a0b18fbab7',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:59:35.590825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: db5b4d63-daba-465e-ac9e-9ff2ea3eb25d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:35.591452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (db5b4d63-daba-465e-ac9e-9ff2ea3eb25d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:35.591815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['62d755d4-51cf-4ded-af28-c7a0b18fbab7'] Oct 09 00:59:35.592219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: f5af4924-89cc-4989-b9ca-dbf47c1434fd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:35.592568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f5af4924-89cc-4989-b9ca-dbf47c1434fd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:35.593340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['62d755d4-51cf-4ded-af28-c7a0b18fbab7'] Oct 09 00:59:35.593715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 0853d9d5-da1a-4c6b-81d5-c6ef153d5109 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:35.594184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0853d9d5-da1a-4c6b-81d5-c6ef153d5109), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:35.594589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['62d755d4-51cf-4ded-af28-c7a0b18fbab7'] Oct 09 00:59:35.595516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 216cfce9-45d3-4c6c-b486-d152a8453f8c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:35.596070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (216cfce9-45d3-4c6c-b486-d152a8453f8c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:35.596393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1489ff1b-58ea-4c14-92aa-7a4f859eb20e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['62d755d4-51cf-4ded-af28-c7a0b18fbab7'] Oct 09 00:59:35.941125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-213ca67c-8ccd-4550-b4a9-7c91b83a9bc7 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port deleted: 6205ae02-54cf-474a-bd53-eb015052af9b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:35.941760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-213ca67c-8ccd-4550-b4a9-7c91b83a9bc7 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (6205ae02-54cf-474a-bd53-eb015052af9b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:36.740508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:351 started Oct 09 00:59:36.742875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eef6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=64000000,duration_sec=719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:36.743477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:36.743835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:351 - starting polling. Elapsed:0.003 Oct 09 00:59:36.746389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:36.748238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 6205ae02-54cf-474a-bd53-eb015052af9b not present in bridge br-int Oct 09 00:59:36.748495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 00:59:36.748781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['6205ae02-54cf-474a-bd53-eb015052af9b'] Oct 09 00:59:36.749102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 6205ae02-54cf-474a-bd53-eb015052af9b is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 00:59:36.753029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:351 - port information retrieved. Elapsed:0.013 Oct 09 00:59:36.753360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:351 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 00:59:38.741718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:352 started Oct 09 00:59:38.744209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eef8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=65000000,duration_sec=721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:38.744917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:38.745263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:352 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:59:40.742507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:353 started Oct 09 00:59:40.745381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eefa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=66000000,duration_sec=723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:40.746026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:40.746436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:353 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 00:59:42.743916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:354 started Oct 09 00:59:42.748487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eefc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=69000000,duration_sec=725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:42.749572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:42.750091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:354 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 00:59:43.095498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a0b47c9-dba5-49c5-bd97-2bb8d3a2f580 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port deleted: 033058db-9b72-4aa7-b12d-bf2294dc0aa3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:43.096395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a0b47c9-dba5-49c5-bd97-2bb8d3a2f580 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (033058db-9b72-4aa7-b12d-bf2294dc0aa3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:43.098391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a0b47c9-dba5-49c5-bd97-2bb8d3a2f580 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group member updated {'777936c7-14aa-4727-901f-85cc3efdcde9'} Oct 09 00:59:44.747794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:355 started Oct 09 00:59:44.751615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eefe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=72000000,duration_sec=727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:44.752508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:44.752991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:355 - starting polling. Elapsed:0.005 Oct 09 00:59:44.756172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:44.758071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 033058db-9b72-4aa7-b12d-bf2294dc0aa3 not present in bridge br-int Oct 09 00:59:44.758554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 00:59:44.759168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['033058db-9b72-4aa7-b12d-bf2294dc0aa3'] Oct 09 00:59:44.759653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 033058db-9b72-4aa7-b12d-bf2294dc0aa3 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 00:59:44.763645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:355 - port information retrieved. Elapsed:0.016 Oct 09 00:59:44.764156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:355 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 09 00:59:45.041308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroup deleted: 777936c7-14aa-4727-901f-85cc3efdcde9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:45.042038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (777936c7-14aa-4727-901f-85cc3efdcde9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.043155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('777936c7-14aa-4727-901f-85cc3efdcde9',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:59:45.086439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('777936c7-14aa-4727-901f-85cc3efdcde9',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:59:45.086941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 0a552fa0-502b-46a8-8fd1-3d4ec162add0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:45.087317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0a552fa0-502b-46a8-8fd1-3d4ec162add0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.087687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['777936c7-14aa-4727-901f-85cc3efdcde9'] Oct 09 00:59:45.088094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: f96c67fe-1914-498a-8272-56a96b5d1697 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:45.088436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f96c67fe-1914-498a-8272-56a96b5d1697), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.088756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['777936c7-14aa-4727-901f-85cc3efdcde9'] Oct 09 00:59:45.089124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: b7986354-8c90-4491-b3a5-558c4ef44ab5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:45.089466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b7986354-8c90-4491-b3a5-558c4ef44ab5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.089817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['777936c7-14aa-4727-901f-85cc3efdcde9'] Oct 09 00:59:45.090185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 737dd766-45d2-4f25-9b85-9ce89fe0e1e3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:45.090527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (737dd766-45d2-4f25-9b85-9ce89fe0e1e3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.090843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eee0b958-6ce3-4b50-bfb1-1587be7d7b35 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['777936c7-14aa-4727-901f-85cc3efdcde9'] Oct 09 00:59:45.507102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bba79fdc-89ad-4f80-a58e-56237432bb0c tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port deleted: ad40b227-899e-4d0c-a7ae-011b3f93ab4f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:45.508425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bba79fdc-89ad-4f80-a58e-56237432bb0c tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (ad40b227-899e-4d0c-a7ae-011b3f93ab4f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.842842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-240ec656-5d9a-468d-83fc-9e5dc8a12428 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T00:59:45Z,description='tempest-description--1579256683',id=1f9b26d3-091b-4cb8-9e8b-e38c72b45b90,is_default=False,name='tempest-securitygroup--238333962',project_id='a7d8e82f58814da6b8c08bfa04955d4c',revision_number=1,rules=[SecurityGroupRule(2c6c58eb-05cf-4fde-b57c-357d4bd68064),SecurityGroupRule(f9b428e9-1f31-47b9-8b65-eb1429c71b27)],shared=False,stateful=True,updated_at=2022-10-09T00:59:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:45.844866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-240ec656-5d9a-468d-83fc-9e5dc8a12428 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (1f9b26d3-091b-4cb8-9e8b-e38c72b45b90), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.845819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-240ec656-5d9a-468d-83fc-9e5dc8a12428 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:59:45Z,description=,direction='egress',ethertype='IPv6',id=2c6c58eb-05cf-4fde-b57c-357d4bd68064,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1f9b26d3-091b-4cb8-9e8b-e38c72b45b90,updated_at=2022-10-09T00:59:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:45.846649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-240ec656-5d9a-468d-83fc-9e5dc8a12428 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2c6c58eb-05cf-4fde-b57c-357d4bd68064), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.847378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-240ec656-5d9a-468d-83fc-9e5dc8a12428 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'] Oct 09 00:59:45.848225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-240ec656-5d9a-468d-83fc-9e5dc8a12428 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:59:45Z,description=,direction='egress',ethertype='IPv4',id=f9b428e9-1f31-47b9-8b65-eb1429c71b27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1f9b26d3-091b-4cb8-9e8b-e38c72b45b90,updated_at=2022-10-09T00:59:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:45.848748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-240ec656-5d9a-468d-83fc-9e5dc8a12428 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f9b428e9-1f31-47b9-8b65-eb1429c71b27), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.849233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-240ec656-5d9a-468d-83fc-9e5dc8a12428 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'] Oct 09 00:59:45.955041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0f9f92fe-795f-4ae7-a2ca-bbaf2e9f39c2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:59:45Z,description='',direction='ingress',ethertype='IPv4',id=19a78f71-fcb9-4cbd-9c24-060cedbc5db6,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1f9b26d3-091b-4cb8-9e8b-e38c72b45b90,updated_at=2022-10-09T00:59:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:45.955530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0f9f92fe-795f-4ae7-a2ca-bbaf2e9f39c2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (19a78f71-fcb9-4cbd-9c24-060cedbc5db6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:45.956036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0f9f92fe-795f-4ae7-a2ca-bbaf2e9f39c2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'] Oct 09 00:59:46.131293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c5f64e89-c9ba-4896-b4a3-4f835030d284 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T00:59:46Z,description='',direction='ingress',ethertype='IPv4',id=6e90d39e-3aaf-4e3f-ace8-4af8f8a3b838,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1f9b26d3-091b-4cb8-9e8b-e38c72b45b90,updated_at=2022-10-09T00:59:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:46.132194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c5f64e89-c9ba-4896-b4a3-4f835030d284 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6e90d39e-3aaf-4e3f-ace8-4af8f8a3b838), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:46.132763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c5f64e89-c9ba-4896-b4a3-4f835030d284 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'] Oct 09 00:59:46.615088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fc3dff3f-ac12-446f-b58e-0b7c85592043 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:59:46Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5ccc52c7-7c6c-4394-b3ff-18c239847473,mac_address=fa:16:3e:ea:b2:4d,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5ccc52c7-7c6c-4394-b3ff-18c239847473),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T00:59:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:46.615613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fc3dff3f-ac12-446f-b58e-0b7c85592043 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (5ccc52c7-7c6c-4394-b3ff-18c239847473), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:46.748322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:356 started Oct 09 00:59:46.754180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=75000000,duration_sec=729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:46.755291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:46.755708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:356 - starting polling. Elapsed:0.007 Oct 09 00:59:46.763102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:46.765481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port ad40b227-899e-4d0c-a7ae-011b3f93ab4f not present in bridge br-int Oct 09 00:59:46.772263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 00:59:46.773089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['ad40b227-899e-4d0c-a7ae-011b3f93ab4f'] Oct 09 00:59:46.773670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port ad40b227-899e-4d0c-a7ae-011b3f93ab4f is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 00:59:46.779090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:356 - port information retrieved. Elapsed:0.031 Oct 09 00:59:46.783173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:356 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.031 Oct 09 00:59:47.023395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fc3dff3f-ac12-446f-b58e-0b7c85592043 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port 5ccc52c7-7c6c-4394-b3ff-18c239847473 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'e54b0d29-912b-491b-a292-71e5c7c5ca18'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:47.024091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fc3dff3f-ac12-446f-b58e-0b7c85592043 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (5ccc52c7-7c6c-4394-b3ff-18c239847473), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:48.753229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:357 started Oct 09 00:59:48.757834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=78000000,duration_sec=731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:48.758784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:48.759343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:357 - starting polling. Elapsed:0.007 Oct 09 00:59:48.762625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:48.768877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:357 - port information retrieved. Elapsed:0.016 Oct 09 00:59:48.769224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:357 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 09 00:59:50.413673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5711a8b5-52bc-4a90-886f-e5c90055b4d5 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T00:59:49Z,data_plane_status=None,description='',device_id='188a0b8d-23e2-4769-94bf-85277c3b0b66',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=29a59039-ac16-488f-ad9d-1a896696e3f6,mac_address=fa:16:3e:9f:b4:cd,name='',network_id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,numa_affinity_policy=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(29a59039-ac16-488f-ad9d-1a896696e3f6),security_group_ids=set([1f9b26d3-091b-4cb8-9e8b-e38c72b45b90]),status='DOWN',updated_at=2022-10-09T00:59:50Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 00:59:50.414199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5711a8b5-52bc-4a90-886f-e5c90055b4d5 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (29a59039-ac16-488f-ad9d-1a896696e3f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:50.414496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5711a8b5-52bc-4a90-886f-e5c90055b4d5 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group member updated {'1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'} Oct 09 00:59:50.753623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:358 started Oct 09 00:59:50.756459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=77000000,duration_sec=733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:50.757114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:50.757554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:358 - starting polling. Elapsed:0.004 Oct 09 00:59:50.760278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:50.764266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:358 - port information retrieved. Elapsed:0.011 Oct 09 00:59:50.765030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:358 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 00:59:51.051090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f6b543ab-e3ca-4aeb-91fe-38e5c777ccf6 service neutron] Resource Port 29a59039-ac16-488f-ad9d-1a896696e3f6 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=29a59039-ac16-488f-ad9d-1a896696e3f6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=29a59039-ac16-488f-ad9d-1a896696e3f6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:51.052335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f6b543ab-e3ca-4aeb-91fe-38e5c777ccf6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (29a59039-ac16-488f-ad9d-1a896696e3f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:51.381142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f6b543ab-e3ca-4aeb-91fe-38e5c777ccf6 service neutron] Resource Port 29a59039-ac16-488f-ad9d-1a896696e3f6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=29a59039-ac16-488f-ad9d-1a896696e3f6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=29a59039-ac16-488f-ad9d-1a896696e3f6,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=29a59039-ac16-488f-ad9d-1a896696e3f6,segment=NetworkSegment(e02957c6-4ac3-44cc-ac85-3fb22cee1088),segment_id=e02957c6-4ac3-44cc-ac85-3fb22cee1088)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:51.381701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f6b543ab-e3ca-4aeb-91fe-38e5c777ccf6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (29a59039-ac16-488f-ad9d-1a896696e3f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:52.754696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:359 started Oct 09 00:59:52.761986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=78000000,duration_sec=735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:52.762763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:52.763233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:359 - starting polling. Elapsed:0.009 Oct 09 00:59:52.766541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:52.770699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:359 - port information retrieved. Elapsed:0.016 Oct 09 00:59:52.770699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:359 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 09 00:59:53.552930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 29a59039-ac16-488f-ad9d-1a896696e3f6 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:53.553595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (29a59039-ac16-488f-ad9d-1a896696e3f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:54.755537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:360 started Oct 09 00:59:54.758049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=79000000,duration_sec=737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:54.758678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:54.759000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:360 - starting polling. Elapsed:0.004 Oct 09 00:59:54.761587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:54.765052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:360 - port information retrieved. Elapsed:0.010 Oct 09 00:59:54.766033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:360 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:55.497615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 29a59039-ac16-488f-ad9d-1a896696e3f6 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 00:59:55.497993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (29a59039-ac16-488f-ad9d-1a896696e3f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:56.757100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:361 started Oct 09 00:59:56.759565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=80000000,duration_sec=739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:56.760198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:56.760626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:361 - starting polling. Elapsed:0.004 Oct 09 00:59:56.763169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:56.766727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:361 - port information retrieved. Elapsed:0.010 Oct 09 00:59:56.767112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:361 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 00:59:57.924595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0a5e3c26-c392-4381-b207-92d8c14c58b9 admin admin] Resource Subnet deleted: f493090a-f183-4394-a1a6-e9dd89363581 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:57.926227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0a5e3c26-c392-4381-b207-92d8c14c58b9 admin admin] Publish callbacks [] for Subnet (f493090a-f183-4394-a1a6-e9dd89363581), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:58.235358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1a13b27b-0d7c-4204-9a31-a4eda81978f7 admin admin] Resource Network deleted: c27214a2-3f39-42ec-9d84-0333462c2425 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:58.235845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1a13b27b-0d7c-4204-9a31-a4eda81978f7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (c27214a2-3f39-42ec-9d84-0333462c2425), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:58.567101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Resource SecurityGroup deleted: 2b5900ad-4eae-41f0-90e9-7084729c73b2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:58.567495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (2b5900ad-4eae-41f0-90e9-7084729c73b2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:58.568181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2b5900ad-4eae-41f0-90e9-7084729c73b2',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 00:59:58.585045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2b5900ad-4eae-41f0-90e9-7084729c73b2',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 00:59:58.586650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Resource SecurityGroupRule deleted: 126d3766-435f-4f11-bd8d-e7d49dd5ef19 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:58.587279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (126d3766-435f-4f11-bd8d-e7d49dd5ef19), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:58.587877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Security group rule updated ['2b5900ad-4eae-41f0-90e9-7084729c73b2'] Oct 09 00:59:58.589123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Resource SecurityGroupRule deleted: 1e8254dc-d8f4-42ba-bddf-0b3a0b2fd410 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:58.589688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1e8254dc-d8f4-42ba-bddf-0b3a0b2fd410), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:58.590012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Security group rule updated ['2b5900ad-4eae-41f0-90e9-7084729c73b2'] Oct 09 00:59:58.590382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Resource SecurityGroupRule deleted: 1f1164dc-b33c-4703-b9fa-409f172d9452 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:58.590722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1f1164dc-b33c-4703-b9fa-409f172d9452), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:58.591037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Security group rule updated ['2b5900ad-4eae-41f0-90e9-7084729c73b2'] Oct 09 00:59:58.591397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Resource SecurityGroupRule deleted: 7c2b86ca-906b-42bc-bbbd-6dad0994e33d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 00:59:58.591907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7c2b86ca-906b-42bc-bbbd-6dad0994e33d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 00:59:58.592426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1bb48e60-5c8e-415f-967a-4979ab21c453 admin admin] Security group rule updated ['2b5900ad-4eae-41f0-90e9-7084729c73b2'] Oct 09 00:59:58.758425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:362 started Oct 09 00:59:58.761856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=82000000,duration_sec=741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 00:59:58.762426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 00:59:58.762946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:362 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:00:00.758375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:363 started Oct 09 01:00:00.760652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=82000000,duration_sec=743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:00.761217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:00.761570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:363 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:02.509793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:00:02Z,description='Default security group',id=2b6cad0e-be36-4592-8592-ce150588a5db,is_default=True,name='default',project_id='f766c4270e944753b745acc0b6bce492',revision_number=1,rules=[SecurityGroupRule(5b8c0c43-677e-4734-add3-1a1415f5a028),SecurityGroupRule(7312220f-e23f-4ffd-b313-6bf8d180d926),SecurityGroupRule(d2b17f80-48e2-47eb-94bc-473d0f8b4d48),SecurityGroupRule(e6e11ef0-26c7-45de-8430-0c2283f72a78)],shared=False,stateful=True,updated_at=2022-10-09T01:00:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:02.510823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (2b6cad0e-be36-4592-8592-ce150588a5db), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.510823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:02Z,description=,direction='ingress',ethertype='IPv4',id=5b8c0c43-677e-4734-add3-1a1415f5a028,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f766c4270e944753b745acc0b6bce492',protocol=,remote_address_group_id=,remote_group_id=2b6cad0e-be36-4592-8592-ce150588a5db,remote_ip_prefix=,revision_number=0,security_group_id=2b6cad0e-be36-4592-8592-ce150588a5db,updated_at=2022-10-09T01:00:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:02.511143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5b8c0c43-677e-4734-add3-1a1415f5a028), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.511458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Security group rule updated ['2b6cad0e-be36-4592-8592-ce150588a5db'] Oct 09 01:00:02.512151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:02Z,description=,direction='egress',ethertype='IPv6',id=7312220f-e23f-4ffd-b313-6bf8d180d926,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f766c4270e944753b745acc0b6bce492',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b6cad0e-be36-4592-8592-ce150588a5db,updated_at=2022-10-09T01:00:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:02.512497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7312220f-e23f-4ffd-b313-6bf8d180d926), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.512819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Security group rule updated ['2b6cad0e-be36-4592-8592-ce150588a5db'] Oct 09 01:00:02.513470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:02Z,description=,direction='egress',ethertype='IPv4',id=d2b17f80-48e2-47eb-94bc-473d0f8b4d48,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f766c4270e944753b745acc0b6bce492',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b6cad0e-be36-4592-8592-ce150588a5db,updated_at=2022-10-09T01:00:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:02.513817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d2b17f80-48e2-47eb-94bc-473d0f8b4d48), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.514137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Security group rule updated ['2b6cad0e-be36-4592-8592-ce150588a5db'] Oct 09 01:00:02.514787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:02Z,description=,direction='ingress',ethertype='IPv6',id=e6e11ef0-26c7-45de-8430-0c2283f72a78,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f766c4270e944753b745acc0b6bce492',protocol=,remote_address_group_id=,remote_group_id=2b6cad0e-be36-4592-8592-ce150588a5db,remote_ip_prefix=,revision_number=0,security_group_id=2b6cad0e-be36-4592-8592-ce150588a5db,updated_at=2022-10-09T01:00:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:02.515135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e6e11ef0-26c7-45de-8430-0c2283f72a78), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.515459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6a9cb9df-4613-4ed4-8fd0-addaa80ff7d8 admin admin] Security group rule updated ['2b6cad0e-be36-4592-8592-ce150588a5db'] Oct 09 01:00:02.645415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Resource SecurityGroup deleted: 2b6cad0e-be36-4592-8592-ce150588a5db {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:02.645788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (2b6cad0e-be36-4592-8592-ce150588a5db), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.646240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2b6cad0e-be36-4592-8592-ce150588a5db',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:00:02.663897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2b6cad0e-be36-4592-8592-ce150588a5db',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:00:02.664722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Resource SecurityGroupRule deleted: 5b8c0c43-677e-4734-add3-1a1415f5a028 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:02.666433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5b8c0c43-677e-4734-add3-1a1415f5a028), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.667147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Security group rule updated ['2b6cad0e-be36-4592-8592-ce150588a5db'] Oct 09 01:00:02.667806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Resource SecurityGroupRule deleted: 7312220f-e23f-4ffd-b313-6bf8d180d926 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:02.669271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7312220f-e23f-4ffd-b313-6bf8d180d926), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.669779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Security group rule updated ['2b6cad0e-be36-4592-8592-ce150588a5db'] Oct 09 01:00:02.671141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Resource SecurityGroupRule deleted: d2b17f80-48e2-47eb-94bc-473d0f8b4d48 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:02.671829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d2b17f80-48e2-47eb-94bc-473d0f8b4d48), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.672330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Security group rule updated ['2b6cad0e-be36-4592-8592-ce150588a5db'] Oct 09 01:00:02.673044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Resource SecurityGroupRule deleted: e6e11ef0-26c7-45de-8430-0c2283f72a78 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:02.673531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e6e11ef0-26c7-45de-8430-0c2283f72a78), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:02.674118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6e7e50c-6950-4607-a934-8b8a4c7d132d admin admin] Security group rule updated ['2b6cad0e-be36-4592-8592-ce150588a5db'] Oct 09 01:00:02.759570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:364 started Oct 09 01:00:02.762218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=83000000,duration_sec=745,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:02.762852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:02.763301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:364 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:04.761132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:365 started Oct 09 01:00:04.763735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=85000000,duration_sec=747,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:04.764347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:04.764760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:365 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:06.761972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:366 started Oct 09 01:00:06.764291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=85000000,duration_sec=749,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:06.764853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:06.765204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:366 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:00:07.128949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:00:06Z,description='Default security group',id=cb51edbf-c6dd-44a1-9ba3-2a5517c4373d,is_default=True,name='default',project_id='9a6e25abae6b4b499a402bc4585bd06f',revision_number=1,rules=[SecurityGroupRule(234d516c-1500-42e0-9817-afcc7c03e37f),SecurityGroupRule(4bf60fb2-3b00-475f-9d7d-5855e251dade),SecurityGroupRule(b0ef9193-c794-4d18-9d77-78a552a95dae),SecurityGroupRule(b4701db0-6c6c-48c1-979c-35eab8e1a4e5)],shared=False,stateful=True,updated_at=2022-10-09T01:00:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:07.129330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (cb51edbf-c6dd-44a1-9ba3-2a5517c4373d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:07.130535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:07Z,description=,direction='egress',ethertype='IPv6',id=234d516c-1500-42e0-9817-afcc7c03e37f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a6e25abae6b4b499a402bc4585bd06f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb51edbf-c6dd-44a1-9ba3-2a5517c4373d,updated_at=2022-10-09T01:00:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:07.130894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (234d516c-1500-42e0-9817-afcc7c03e37f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:07.131252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Security group rule updated ['cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'] Oct 09 01:00:07.131956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:07Z,description=,direction='ingress',ethertype='IPv6',id=4bf60fb2-3b00-475f-9d7d-5855e251dade,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a6e25abae6b4b499a402bc4585bd06f',protocol=,remote_address_group_id=,remote_group_id=cb51edbf-c6dd-44a1-9ba3-2a5517c4373d,remote_ip_prefix=,revision_number=0,security_group_id=cb51edbf-c6dd-44a1-9ba3-2a5517c4373d,updated_at=2022-10-09T01:00:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:07.132305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4bf60fb2-3b00-475f-9d7d-5855e251dade), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:07.132633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Security group rule updated ['cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'] Oct 09 01:00:07.133284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:07Z,description=,direction='egress',ethertype='IPv4',id=b0ef9193-c794-4d18-9d77-78a552a95dae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a6e25abae6b4b499a402bc4585bd06f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb51edbf-c6dd-44a1-9ba3-2a5517c4373d,updated_at=2022-10-09T01:00:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:07.133722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b0ef9193-c794-4d18-9d77-78a552a95dae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:07.134053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Security group rule updated ['cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'] Oct 09 01:00:07.134716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:07Z,description=,direction='ingress',ethertype='IPv4',id=b4701db0-6c6c-48c1-979c-35eab8e1a4e5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a6e25abae6b4b499a402bc4585bd06f',protocol=,remote_address_group_id=,remote_group_id=cb51edbf-c6dd-44a1-9ba3-2a5517c4373d,remote_ip_prefix=,revision_number=0,security_group_id=cb51edbf-c6dd-44a1-9ba3-2a5517c4373d,updated_at=2022-10-09T01:00:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:07.135059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b4701db0-6c6c-48c1-979c-35eab8e1a4e5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:07.135384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Security group rule updated ['cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'] Oct 09 01:00:07.486974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:00:07Z,data_plane_status=None,description='',device_id='a6b016ec-cbc1-4ad4-8e80-e79fddc5360d',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=48bbfa7d-9313-405d-883a-e594cf9f5314,mac_address=fa:16:3e:39:97:5a,name='',network_id=d06c7078-5fd3-49c5-a343-f0fce7616611,numa_affinity_policy=,project_id='9a6e25abae6b4b499a402bc4585bd06f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(48bbfa7d-9313-405d-883a-e594cf9f5314),security_group_ids=set([cb51edbf-c6dd-44a1-9ba3-2a5517c4373d]),status='DOWN',updated_at=2022-10-09T01:00:07Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:07.487569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (48bbfa7d-9313-405d-883a-e594cf9f5314), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:07.488147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-abcc7882-202a-4148-be40-e4149449ee28 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Security group member updated {'cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'} Oct 09 01:00:08.036452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-596f7916-150c-407f-9ccc-2c14613cf7ab service neutron] Resource Port 48bbfa7d-9313-405d-883a-e594cf9f5314 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=48bbfa7d-9313-405d-883a-e594cf9f5314,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=48bbfa7d-9313-405d-883a-e594cf9f5314,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:08.037018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-596f7916-150c-407f-9ccc-2c14613cf7ab service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (48bbfa7d-9313-405d-883a-e594cf9f5314), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:08.302553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-596f7916-150c-407f-9ccc-2c14613cf7ab service neutron] Resource Port 48bbfa7d-9313-405d-883a-e594cf9f5314 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=48bbfa7d-9313-405d-883a-e594cf9f5314,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=48bbfa7d-9313-405d-883a-e594cf9f5314,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=48bbfa7d-9313-405d-883a-e594cf9f5314,segment=NetworkSegment(e013aba5-13d0-409b-8810-bf9ea4c8b0d4),segment_id=e013aba5-13d0-409b-8810-bf9ea4c8b0d4)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:08.303266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-596f7916-150c-407f-9ccc-2c14613cf7ab service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (48bbfa7d-9313-405d-883a-e594cf9f5314), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:08.763134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:367 started Oct 09 01:00:08.765520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=86000000,duration_sec=751,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:08.766086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:08.766420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:367 - starting polling. Elapsed:0.004 Oct 09 01:00:08.769049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:08.772489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:367 - port information retrieved. Elapsed:0.010 Oct 09 01:00:08.772820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:367 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:00:10.763617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:368 started Oct 09 01:00:10.765963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=87000000,duration_sec=753,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:10.766519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:10.766867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:368 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:00:11.582240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 48bbfa7d-9313-405d-883a-e594cf9f5314 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:11.583255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (48bbfa7d-9313-405d-883a-e594cf9f5314), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:12.764078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:369 started Oct 09 01:00:12.766663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=88000000,duration_sec=755,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:12.767225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:12.767559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:369 - starting polling. Elapsed:0.004 Oct 09 01:00:12.770693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:12.774175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:369 - port information retrieved. Elapsed:0.010 Oct 09 01:00:12.774509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:369 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 01:00:13.602221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 48bbfa7d-9313-405d-883a-e594cf9f5314 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:13.602889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (48bbfa7d-9313-405d-883a-e594cf9f5314), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:14.765337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:370 started Oct 09 01:00:14.767824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=89000000,duration_sec=757,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:14.768388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:14.768715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:370 - starting polling. Elapsed:0.004 Oct 09 01:00:14.771325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:14.774811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:370 - port information retrieved. Elapsed:0.010 Oct 09 01:00:14.775136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:370 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:00:16.766134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:371 started Oct 09 01:00:16.768579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=89000000,duration_sec=759,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:16.769139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:16.769489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:371 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:18.495417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a1d7d60a-de54-4833-ba99-df2afa60b6c4 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Resource Port deleted: 48bbfa7d-9313-405d-883a-e594cf9f5314 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:18.496045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a1d7d60a-de54-4833-ba99-df2afa60b6c4 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (48bbfa7d-9313-405d-883a-e594cf9f5314), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:18.496494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a1d7d60a-de54-4833-ba99-df2afa60b6c4 tempest-VolumesNegativeTest-1245383054 tempest-VolumesNegativeTest-1245383054-project] Security group member updated {'cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'} Oct 09 01:00:18.767553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:372 started Oct 09 01:00:18.771004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=91000000,duration_sec=761,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:18.771580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:18.771945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:372 - starting polling. Elapsed:0.005 Oct 09 01:00:18.774604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:18.776813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 48bbfa7d-9313-405d-883a-e594cf9f5314 not present in bridge br-int Oct 09 01:00:18.776813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:00:18.777327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['48bbfa7d-9313-405d-883a-e594cf9f5314'] Oct 09 01:00:18.777590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 48bbfa7d-9313-405d-883a-e594cf9f5314 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:00:18.781098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:372 - port information retrieved. Elapsed:0.014 Oct 09 01:00:18.781431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:372 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 09 01:00:20.768272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:373 started Oct 09 01:00:20.770664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=92000000,duration_sec=763,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:20.771228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:20.771683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:373 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:22.768816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:374 started Oct 09 01:00:22.771902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=93000000,duration_sec=765,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:22.772467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:22.772820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:374 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:23.911069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Resource SecurityGroup deleted: cb51edbf-c6dd-44a1-9ba3-2a5517c4373d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:23.911648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (cb51edbf-c6dd-44a1-9ba3-2a5517c4373d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:23.912270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cb51edbf-c6dd-44a1-9ba3-2a5517c4373d',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:00:23.925548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cb51edbf-c6dd-44a1-9ba3-2a5517c4373d',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:00:23.926092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Resource SecurityGroupRule deleted: 234d516c-1500-42e0-9817-afcc7c03e37f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:23.926471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (234d516c-1500-42e0-9817-afcc7c03e37f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:23.926820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Security group rule updated ['cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'] Oct 09 01:00:23.927230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Resource SecurityGroupRule deleted: 4bf60fb2-3b00-475f-9d7d-5855e251dade {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:23.927828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4bf60fb2-3b00-475f-9d7d-5855e251dade), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:23.928149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Security group rule updated ['cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'] Oct 09 01:00:23.928515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Resource SecurityGroupRule deleted: b0ef9193-c794-4d18-9d77-78a552a95dae {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:23.928881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b0ef9193-c794-4d18-9d77-78a552a95dae), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:23.929489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Security group rule updated ['cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'] Oct 09 01:00:23.930149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Resource SecurityGroupRule deleted: b4701db0-6c6c-48c1-979c-35eab8e1a4e5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:23.930498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b4701db0-6c6c-48c1-979c-35eab8e1a4e5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:23.930813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2a2f51a-85d7-455d-ba7a-7af258280e1f admin admin] Security group rule updated ['cb51edbf-c6dd-44a1-9ba3-2a5517c4373d'] Oct 09 01:00:24.769614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:375 started Oct 09 01:00:24.772049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=93000000,duration_sec=767,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:24.772614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:24.772969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:375 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:25.290710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e8d771ce-8b4c-4872-86d0-df85f132dfb7 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource Port deleted: 035fc085-892c-4866-9ff4-6bd3d7193e9b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:25.291299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e8d771ce-8b4c-4872-86d0-df85f132dfb7 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (035fc085-892c-4866-9ff4-6bd3d7193e9b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:25.291714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e8d771ce-8b4c-4872-86d0-df85f132dfb7 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group member updated {'40866277-1b5e-448e-aa7a-22cc7be390c9'} Oct 09 01:00:26.770796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:376 started Oct 09 01:00:26.773159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=94000000,duration_sec=769,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:26.773720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:26.774070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:376 - starting polling. Elapsed:0.003 Oct 09 01:00:26.776630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:26.778631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 035fc085-892c-4866-9ff4-6bd3d7193e9b not present in bridge br-int Oct 09 01:00:26.778994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:00:26.779274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['035fc085-892c-4866-9ff4-6bd3d7193e9b'] Oct 09 01:00:26.779603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 035fc085-892c-4866-9ff4-6bd3d7193e9b is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:00:26.782919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:376 - port information retrieved. Elapsed:0.012 Oct 09 01:00:26.783243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:376 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:00:28.487302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroup deleted: 40866277-1b5e-448e-aa7a-22cc7be390c9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:28.487982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (40866277-1b5e-448e-aa7a-22cc7be390c9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:28.488516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('40866277-1b5e-448e-aa7a-22cc7be390c9',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:00:28.504376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('40866277-1b5e-448e-aa7a-22cc7be390c9',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:00:28.504949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroupRule deleted: 1bbebb52-de77-4783-a1e8-86a6bc6a76be {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:28.505538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1bbebb52-de77-4783-a1e8-86a6bc6a76be), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:28.506107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['40866277-1b5e-448e-aa7a-22cc7be390c9'] Oct 09 01:00:28.506702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroupRule deleted: 2d70d5cf-f1b2-4920-b4e5-26637c56de54 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:28.507139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2d70d5cf-f1b2-4920-b4e5-26637c56de54), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:28.507518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['40866277-1b5e-448e-aa7a-22cc7be390c9'] Oct 09 01:00:28.507977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroupRule deleted: a3c8b13e-6dcb-464d-868b-50ddba5e3219 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:28.508435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a3c8b13e-6dcb-464d-868b-50ddba5e3219), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:28.508853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['40866277-1b5e-448e-aa7a-22cc7be390c9'] Oct 09 01:00:28.509371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroupRule deleted: dfa4f977-10b3-454c-bea6-78915956a806 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:28.509864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (dfa4f977-10b3-454c-bea6-78915956a806), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:28.510180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-25a8960b-f46d-4d09-b14a-c07bcb02be9c tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['40866277-1b5e-448e-aa7a-22cc7be390c9'] Oct 09 01:00:28.772250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:377 started Oct 09 01:00:28.776048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=97000000,duration_sec=771,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:28.776722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:28.777432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:377 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 01:00:28.884082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2b72d463-7d58-47fa-aaa7-2b8b6eeb08a7 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource Port deleted: 8ab86119-a53c-43d3-aeed-7d526b4e9475 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:28.884595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2b72d463-7d58-47fa-aaa7-2b8b6eeb08a7 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (8ab86119-a53c-43d3-aeed-7d526b4e9475), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:29.182306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfd68a40-028e-45d3-8abe-58fc6c7f55f3 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:00:29Z,description='tempest-description--856372579',id=2a9a84d8-6b62-42b6-be63-f330ce004a76,is_default=False,name='tempest-securitygroup--477921715',project_id='40e631c5e320489cac9cea85118c6263',revision_number=1,rules=[SecurityGroupRule(59cb45b2-5a88-4e51-851f-4575b693b139),SecurityGroupRule(8b6501a8-5653-4675-a246-cac24386b058)],shared=False,stateful=True,updated_at=2022-10-09T01:00:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:29.183120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfd68a40-028e-45d3-8abe-58fc6c7f55f3 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (2a9a84d8-6b62-42b6-be63-f330ce004a76), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:29.184182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfd68a40-028e-45d3-8abe-58fc6c7f55f3 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:29Z,description=,direction='egress',ethertype='IPv6',id=59cb45b2-5a88-4e51-851f-4575b693b139,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a9a84d8-6b62-42b6-be63-f330ce004a76,updated_at=2022-10-09T01:00:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:29.184725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfd68a40-028e-45d3-8abe-58fc6c7f55f3 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (59cb45b2-5a88-4e51-851f-4575b693b139), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:29.185374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cfd68a40-028e-45d3-8abe-58fc6c7f55f3 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['2a9a84d8-6b62-42b6-be63-f330ce004a76'] Oct 09 01:00:29.186428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfd68a40-028e-45d3-8abe-58fc6c7f55f3 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:29Z,description=,direction='egress',ethertype='IPv4',id=8b6501a8-5653-4675-a246-cac24386b058,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a9a84d8-6b62-42b6-be63-f330ce004a76,updated_at=2022-10-09T01:00:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:29.187002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfd68a40-028e-45d3-8abe-58fc6c7f55f3 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8b6501a8-5653-4675-a246-cac24386b058), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:29.187497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cfd68a40-028e-45d3-8abe-58fc6c7f55f3 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['2a9a84d8-6b62-42b6-be63-f330ce004a76'] Oct 09 01:00:29.297492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dfe40858-59d8-4ac1-a56c-09458603675f tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:29Z,description='',direction='ingress',ethertype='IPv4',id=b0d35072-a134-46a4-b377-a66c1f6d69de,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='40e631c5e320489cac9cea85118c6263',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a9a84d8-6b62-42b6-be63-f330ce004a76,updated_at=2022-10-09T01:00:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:29.297817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dfe40858-59d8-4ac1-a56c-09458603675f tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b0d35072-a134-46a4-b377-a66c1f6d69de), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:29.298189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dfe40858-59d8-4ac1-a56c-09458603675f tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['2a9a84d8-6b62-42b6-be63-f330ce004a76'] Oct 09 01:00:29.431987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c3610ff3-1bad-4446-959e-103a05f1d0a9 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:29Z,description='',direction='ingress',ethertype='IPv4',id=8238b067-b155-4906-9f74-9082760e357e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40e631c5e320489cac9cea85118c6263',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a9a84d8-6b62-42b6-be63-f330ce004a76,updated_at=2022-10-09T01:00:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:29.432516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c3610ff3-1bad-4446-959e-103a05f1d0a9 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8238b067-b155-4906-9f74-9082760e357e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:29.432862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c3610ff3-1bad-4446-959e-103a05f1d0a9 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['2a9a84d8-6b62-42b6-be63-f330ce004a76'] Oct 09 01:00:29.871514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4d34f8bf-506b-453a-810c-8d2784eca790 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:00:29Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=091534a1-925c-45ea-b86d-37c86c13337d,mac_address=fa:16:3e:70:56:e9,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(091534a1-925c-45ea-b86d-37c86c13337d),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T01:00:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:29.872747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4d34f8bf-506b-453a-810c-8d2784eca790 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (091534a1-925c-45ea-b86d-37c86c13337d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:30.199279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4d34f8bf-506b-453a-810c-8d2784eca790 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource Port 091534a1-925c-45ea-b86d-37c86c13337d updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'c097cc2b-694c-48da-a1d1-96b649629cfc'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:30.199672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4d34f8bf-506b-453a-810c-8d2784eca790 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (091534a1-925c-45ea-b86d-37c86c13337d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:30.772551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:378 started Oct 09 01:00:30.775053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=96000000,duration_sec=773,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:30.775767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:30.775965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:378 - starting polling. Elapsed:0.004 Oct 09 01:00:30.778859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:30.780678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8ab86119-a53c-43d3-aeed-7d526b4e9475 not present in bridge br-int Oct 09 01:00:30.781005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:00:30.781286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['8ab86119-a53c-43d3-aeed-7d526b4e9475'] Oct 09 01:00:30.781599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8ab86119-a53c-43d3-aeed-7d526b4e9475 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:00:30.785051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:378 - port information retrieved. Elapsed:0.013 Oct 09 01:00:30.785377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:378 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:00:32.773616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:379 started Oct 09 01:00:32.776013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=97000000,duration_sec=775,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:32.776575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:32.777192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:379 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:00:33.441740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ec8aca92-03de-41fe-b935-a027ad71a310 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:00:33Z,data_plane_status=None,description='',device_id='bf1a22b3-a821-421e-8d9e-93190101a78d',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0b9a0bca-1f0d-4dc1-a233-b41357e21184,mac_address=fa:16:3e:7b:d3:f0,name='',network_id=93a9ba3d-37f0-48ce-9786-b421e5404102,numa_affinity_policy=,project_id='40e631c5e320489cac9cea85118c6263',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0b9a0bca-1f0d-4dc1-a233-b41357e21184),security_group_ids=set([2a9a84d8-6b62-42b6-be63-f330ce004a76]),status='DOWN',updated_at=2022-10-09T01:00:33Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:33.442643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ec8aca92-03de-41fe-b935-a027ad71a310 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0b9a0bca-1f0d-4dc1-a233-b41357e21184), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:33.443331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ec8aca92-03de-41fe-b935-a027ad71a310 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group member updated {'2a9a84d8-6b62-42b6-be63-f330ce004a76'} Oct 09 01:00:34.208263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f354e6ed-0326-499a-8a7e-b256ee8cfdb9 service neutron] Resource Port 0b9a0bca-1f0d-4dc1-a233-b41357e21184 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=0b9a0bca-1f0d-4dc1-a233-b41357e21184,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b9a0bca-1f0d-4dc1-a233-b41357e21184,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:34.209672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f354e6ed-0326-499a-8a7e-b256ee8cfdb9 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0b9a0bca-1f0d-4dc1-a233-b41357e21184), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:34.661549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f354e6ed-0326-499a-8a7e-b256ee8cfdb9 service neutron] Resource Port 0b9a0bca-1f0d-4dc1-a233-b41357e21184 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b9a0bca-1f0d-4dc1-a233-b41357e21184,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b9a0bca-1f0d-4dc1-a233-b41357e21184,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0b9a0bca-1f0d-4dc1-a233-b41357e21184,segment=NetworkSegment(47eb43ca-62f0-426c-bb7d-8fbf6653ed4a),segment_id=47eb43ca-62f0-426c-bb7d-8fbf6653ed4a)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:34.661928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f354e6ed-0326-499a-8a7e-b256ee8cfdb9 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0b9a0bca-1f0d-4dc1-a233-b41357e21184), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:34.774962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:380 started Oct 09 01:00:34.778308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=98000000,duration_sec=777,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:34.778906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:34.779254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:380 - starting polling. Elapsed:0.004 Oct 09 01:00:34.781803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:34.785827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:380 - port information retrieved. Elapsed:0.010 Oct 09 01:00:34.786176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:380 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 01:00:36.775925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:381 started Oct 09 01:00:36.778547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=99000000,duration_sec=779,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:36.779104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:36.779458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:381 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:37.700545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 0b9a0bca-1f0d-4dc1-a233-b41357e21184 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:37.700929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0b9a0bca-1f0d-4dc1-a233-b41357e21184), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:38.776981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:382 started Oct 09 01:00:38.779310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=100000000,duration_sec=781,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:38.779923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:38.780287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:382 - starting polling. Elapsed:0.004 Oct 09 01:00:38.782824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:38.786305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:382 - port information retrieved. Elapsed:0.010 Oct 09 01:00:38.786641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:382 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:00:39.685365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 0b9a0bca-1f0d-4dc1-a233-b41357e21184 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:39.685746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0b9a0bca-1f0d-4dc1-a233-b41357e21184), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:40.777444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:383 started Oct 09 01:00:40.779832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=101000000,duration_sec=783,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:40.780384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:40.780713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:383 - starting polling. Elapsed:0.003 Oct 09 01:00:40.783225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:40.787258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:383 - port information retrieved. Elapsed:0.010 Oct 09 01:00:40.787618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:383 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:00:42.778658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:384 started Oct 09 01:00:42.781170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=102000000,duration_sec=785,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:42.781775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:42.782135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:384 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:44.780029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:385 started Oct 09 01:00:44.782659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=103000000,duration_sec=787,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:44.783225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:44.783580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:385 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:46.781222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:386 started Oct 09 01:00:46.783669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=105000000,duration_sec=789,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:46.784858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:46.785209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:386 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:48.782451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:387 started Oct 09 01:00:48.785423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=106000000,duration_sec=791,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:48.786127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:48.786698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:387 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:00:49.137972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6ee30ec7-3667-4cb0-bfae-d62b91088452 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port deleted: 29a59039-ac16-488f-ad9d-1a896696e3f6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:49.138462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6ee30ec7-3667-4cb0-bfae-d62b91088452 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (29a59039-ac16-488f-ad9d-1a896696e3f6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:49.138986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6ee30ec7-3667-4cb0-bfae-d62b91088452 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group member updated {'1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'} Oct 09 01:00:50.783459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:388 started Oct 09 01:00:50.786799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=107000000,duration_sec=793,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:50.787378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:50.787750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:388 - starting polling. Elapsed:0.004 Oct 09 01:00:50.790275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:50.792075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 29a59039-ac16-488f-ad9d-1a896696e3f6 not present in bridge br-int Oct 09 01:00:50.792395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:00:50.792673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['29a59039-ac16-488f-ad9d-1a896696e3f6'] Oct 09 01:00:50.792986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 29a59039-ac16-488f-ad9d-1a896696e3f6 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:00:50.796354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:388 - port information retrieved. Elapsed:0.013 Oct 09 01:00:50.796680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:388 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:00:51.384767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroup deleted: 1f9b26d3-091b-4cb8-9e8b-e38c72b45b90 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:51.385150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (1f9b26d3-091b-4cb8-9e8b-e38c72b45b90), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:51.385599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1f9b26d3-091b-4cb8-9e8b-e38c72b45b90',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:00:51.400089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1f9b26d3-091b-4cb8-9e8b-e38c72b45b90',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:00:51.400578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 2c6c58eb-05cf-4fde-b57c-357d4bd68064 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:51.400947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2c6c58eb-05cf-4fde-b57c-357d4bd68064), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:51.401284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'] Oct 09 01:00:51.401982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: f9b428e9-1f31-47b9-8b65-eb1429c71b27 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:51.402328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f9b428e9-1f31-47b9-8b65-eb1429c71b27), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:51.402657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'] Oct 09 01:00:51.403035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 19a78f71-fcb9-4cbd-9c24-060cedbc5db6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:51.403396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (19a78f71-fcb9-4cbd-9c24-060cedbc5db6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:51.403747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'] Oct 09 01:00:51.404114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 6e90d39e-3aaf-4e3f-ace8-4af8f8a3b838 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:51.404452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6e90d39e-3aaf-4e3f-ace8-4af8f8a3b838), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:51.404767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-260b11c0-3e36-4dcd-97f0-5980e1ef1dab tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['1f9b26d3-091b-4cb8-9e8b-e38c72b45b90'] Oct 09 01:00:51.947831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ebbf3d7b-ad1c-4b3c-a806-23edf999f0d8 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port deleted: 5ccc52c7-7c6c-4394-b3ff-18c239847473 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:00:51.948446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ebbf3d7b-ad1c-4b3c-a806-23edf999f0d8 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (5ccc52c7-7c6c-4394-b3ff-18c239847473), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:52.212930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5ad6ab3b-9415-417b-9c49-fd145323c0e2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:00:52Z,description='tempest-description--563614152',id=0ea9187f-2101-4156-8867-3f35f5d56794,is_default=False,name='tempest-securitygroup--769657378',project_id='a7d8e82f58814da6b8c08bfa04955d4c',revision_number=1,rules=[SecurityGroupRule(5febc4de-a5d3-450e-a79f-be5f7ef57b14),SecurityGroupRule(fe5abf39-fe9f-4194-82a2-bcaf13449139)],shared=False,stateful=True,updated_at=2022-10-09T01:00:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:52.213376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5ad6ab3b-9415-417b-9c49-fd145323c0e2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (0ea9187f-2101-4156-8867-3f35f5d56794), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:52.214066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5ad6ab3b-9415-417b-9c49-fd145323c0e2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:52Z,description=,direction='egress',ethertype='IPv6',id=5febc4de-a5d3-450e-a79f-be5f7ef57b14,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ea9187f-2101-4156-8867-3f35f5d56794,updated_at=2022-10-09T01:00:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:52.214496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5ad6ab3b-9415-417b-9c49-fd145323c0e2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5febc4de-a5d3-450e-a79f-be5f7ef57b14), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:52.214892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5ad6ab3b-9415-417b-9c49-fd145323c0e2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['0ea9187f-2101-4156-8867-3f35f5d56794'] Oct 09 01:00:52.215726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5ad6ab3b-9415-417b-9c49-fd145323c0e2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:52Z,description=,direction='egress',ethertype='IPv4',id=fe5abf39-fe9f-4194-82a2-bcaf13449139,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ea9187f-2101-4156-8867-3f35f5d56794,updated_at=2022-10-09T01:00:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:52.216079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5ad6ab3b-9415-417b-9c49-fd145323c0e2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fe5abf39-fe9f-4194-82a2-bcaf13449139), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:52.216431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5ad6ab3b-9415-417b-9c49-fd145323c0e2 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['0ea9187f-2101-4156-8867-3f35f5d56794'] Oct 09 01:00:52.323070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6d9b8f6a-43e6-49a6-b638-58a540827b9b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:52Z,description='',direction='ingress',ethertype='IPv4',id=10ea2549-d879-4797-8c45-dbf04cf1fdbf,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ea9187f-2101-4156-8867-3f35f5d56794,updated_at=2022-10-09T01:00:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:52.323444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6d9b8f6a-43e6-49a6-b638-58a540827b9b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (10ea2549-d879-4797-8c45-dbf04cf1fdbf), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:52.323870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6d9b8f6a-43e6-49a6-b638-58a540827b9b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['0ea9187f-2101-4156-8867-3f35f5d56794'] Oct 09 01:00:52.446190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1296968c-2e43-4e7d-ac4c-7db8587737e6 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:00:52Z,description='',direction='ingress',ethertype='IPv4',id=c8681dce-ecd5-4f9f-9f59-9f7b379e5092,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ea9187f-2101-4156-8867-3f35f5d56794,updated_at=2022-10-09T01:00:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:52.446601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1296968c-2e43-4e7d-ac4c-7db8587737e6 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c8681dce-ecd5-4f9f-9f59-9f7b379e5092), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:52.446938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1296968c-2e43-4e7d-ac4c-7db8587737e6 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['0ea9187f-2101-4156-8867-3f35f5d56794'] Oct 09 01:00:52.784361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:389 started Oct 09 01:00:52.786776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=108000000,duration_sec=795,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:52.787377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:52.787741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:389 - starting polling. Elapsed:0.003 Oct 09 01:00:52.790313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:52.792168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 5ccc52c7-7c6c-4394-b3ff-18c239847473 not present in bridge br-int Oct 09 01:00:52.792485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:00:52.792766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['5ccc52c7-7c6c-4394-b3ff-18c239847473'] Oct 09 01:00:52.793104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 5ccc52c7-7c6c-4394-b3ff-18c239847473 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:00:52.796500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:389 - port information retrieved. Elapsed:0.012 Oct 09 01:00:52.796829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:389 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:00:52.854665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e4788962-c986-444f-b74b-eb8fda9db05e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:00:52Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ae310aaf-3088-4039-aa5d-01e69bb90c0b,mac_address=fa:16:3e:37:09:90,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ae310aaf-3088-4039-aa5d-01e69bb90c0b),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T01:00:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:52.855048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e4788962-c986-444f-b74b-eb8fda9db05e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ae310aaf-3088-4039-aa5d-01e69bb90c0b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:53.192234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e4788962-c986-444f-b74b-eb8fda9db05e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port ae310aaf-3088-4039-aa5d-01e69bb90c0b updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'e1c59e0b-bc5f-44bd-967c-0dd5101e4fd2'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:53.192859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e4788962-c986-444f-b74b-eb8fda9db05e tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ae310aaf-3088-4039-aa5d-01e69bb90c0b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:54.785538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:390 started Oct 09 01:00:54.788452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=109000000,duration_sec=797,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:54.789025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:54.789356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:390 - starting polling. Elapsed:0.004 Oct 09 01:00:54.791948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:54.795390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:390 - port information retrieved. Elapsed:0.010 Oct 09 01:00:54.795853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:390 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:00:56.455820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2abb350-4f51-46cf-bc9b-46656e4103eb tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:00:56Z,data_plane_status=None,description='',device_id='e0d9a7c4-b33c-42c1-9042-dfd357bc3932',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=bf1ecde5-a035-439a-96b4-f7a4880b70e4,mac_address=fa:16:3e:28:2f:b7,name='',network_id=ef6b019b-3ff0-42c3-b2bd-354f2c856ccc,numa_affinity_policy=,project_id='a7d8e82f58814da6b8c08bfa04955d4c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(bf1ecde5-a035-439a-96b4-f7a4880b70e4),security_group_ids=set([0ea9187f-2101-4156-8867-3f35f5d56794]),status='DOWN',updated_at=2022-10-09T01:00:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:00:56.456559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2abb350-4f51-46cf-bc9b-46656e4103eb tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bf1ecde5-a035-439a-96b4-f7a4880b70e4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:56.457242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b2abb350-4f51-46cf-bc9b-46656e4103eb tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group member updated {'0ea9187f-2101-4156-8867-3f35f5d56794'} Oct 09 01:00:56.786621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:391 started Oct 09 01:00:56.789133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=110000000,duration_sec=799,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:56.789868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:56.790352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:391 - starting polling. Elapsed:0.004 Oct 09 01:00:56.792979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:56.796551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:391 - port information retrieved. Elapsed:0.010 Oct 09 01:00:56.796995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:391 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 01:00:57.024581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b7cb1db3-5974-4c86-a45e-fa8341f662f6 service neutron] Resource Port bf1ecde5-a035-439a-96b4-f7a4880b70e4 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=bf1ecde5-a035-439a-96b4-f7a4880b70e4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=bf1ecde5-a035-439a-96b4-f7a4880b70e4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:57.024963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b7cb1db3-5974-4c86-a45e-fa8341f662f6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bf1ecde5-a035-439a-96b4-f7a4880b70e4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:57.279296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b7cb1db3-5974-4c86-a45e-fa8341f662f6 service neutron] Resource Port bf1ecde5-a035-439a-96b4-f7a4880b70e4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=bf1ecde5-a035-439a-96b4-f7a4880b70e4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=bf1ecde5-a035-439a-96b4-f7a4880b70e4,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=bf1ecde5-a035-439a-96b4-f7a4880b70e4,segment=NetworkSegment(e02957c6-4ac3-44cc-ac85-3fb22cee1088),segment_id=e02957c6-4ac3-44cc-ac85-3fb22cee1088)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:57.279736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b7cb1db3-5974-4c86-a45e-fa8341f662f6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bf1ecde5-a035-439a-96b4-f7a4880b70e4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:58.787620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:392 started Oct 09 01:00:58.790184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=111000000,duration_sec=801,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:00:58.790919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:00:58.791369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:392 - starting polling. Elapsed:0.004 Oct 09 01:00:58.793960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:00:58.797439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:392 - port information retrieved. Elapsed:0.010 Oct 09 01:00:58.797797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:392 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:00:59.792225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port bf1ecde5-a035-439a-96b4-f7a4880b70e4 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:00:59.792816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bf1ecde5-a035-439a-96b4-f7a4880b70e4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:00.788317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:393 started Oct 09 01:01:00.790622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=112000000,duration_sec=803,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:00.791183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:00.791516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:393 - starting polling. Elapsed:0.003 Oct 09 01:01:00.794122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:00.797580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:393 - port information retrieved. Elapsed:0.009 Oct 09 01:01:00.797910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:393 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:01:01.793571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port bf1ecde5-a035-439a-96b4-f7a4880b70e4 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:01.793957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bf1ecde5-a035-439a-96b4-f7a4880b70e4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:02.789744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:394 started Oct 09 01:01:02.792014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=113000000,duration_sec=805,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:02.792581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:02.792914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:394 - starting polling. Elapsed:0.003 Oct 09 01:01:02.795513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:02.799080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:394 - port information retrieved. Elapsed:0.009 Oct 09 01:01:02.800038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:394 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:01:04.791521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:395 started Oct 09 01:01:04.793822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=115000000,duration_sec=807,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:04.794373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:04.794717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:395 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:01:06.792579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:396 started Oct 09 01:01:06.795063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=116000000,duration_sec=809,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:06.795654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:06.796005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:396 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:01:08.794037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:397 started Oct 09 01:01:08.796594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=118000000,duration_sec=811,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:08.797228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:08.797677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:397 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:01:10.795379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:398 started Oct 09 01:01:10.797767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=119000000,duration_sec=813,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:10.798321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:10.798671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:398 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:01:12.796368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:399 started Oct 09 01:01:12.798629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=120000000,duration_sec=815,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:12.799206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:12.799552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:399 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:01:13.048698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c51cd76a-8ff5-4784-9827-c53889a2a00c tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource Port deleted: af11de25-9b71-43af-8ce0-051a32ec945c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:13.049420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c51cd76a-8ff5-4784-9827-c53889a2a00c tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (af11de25-9b71-43af-8ce0-051a32ec945c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:13.049835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c51cd76a-8ff5-4784-9827-c53889a2a00c tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group member updated {'e9a9d17f-82f7-47af-9567-ad6387a276da'} Oct 09 01:01:14.762619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource SecurityGroup deleted: e9a9d17f-82f7-47af-9567-ad6387a276da {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:14.763217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (e9a9d17f-82f7-47af-9567-ad6387a276da), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:14.763428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e9a9d17f-82f7-47af-9567-ad6387a276da',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:01:14.777204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e9a9d17f-82f7-47af-9567-ad6387a276da',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:01:14.777692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource SecurityGroupRule deleted: 2e5353c6-bbb2-46b6-8cbf-32ab364d1324 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:14.778066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2e5353c6-bbb2-46b6-8cbf-32ab364d1324), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:14.778400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group rule updated ['e9a9d17f-82f7-47af-9567-ad6387a276da'] Oct 09 01:01:14.778790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource SecurityGroupRule deleted: 88d2319b-658a-45bb-b777-726420afbccd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:14.779139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (88d2319b-658a-45bb-b777-726420afbccd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:14.779460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group rule updated ['e9a9d17f-82f7-47af-9567-ad6387a276da'] Oct 09 01:01:14.779860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource SecurityGroupRule deleted: 1c2d3c35-05d4-4dc0-93cb-7526c38958bc {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:14.780205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1c2d3c35-05d4-4dc0-93cb-7526c38958bc), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:14.780527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group rule updated ['e9a9d17f-82f7-47af-9567-ad6387a276da'] Oct 09 01:01:14.780896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource SecurityGroupRule deleted: 5dfdbab2-fc0e-45a4-b148-80bb871ce5b4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:14.781237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5dfdbab2-fc0e-45a4-b148-80bb871ce5b4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:14.781555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-d18ef90a-e333-4f73-8217-961f6d46b1fc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group rule updated ['e9a9d17f-82f7-47af-9567-ad6387a276da'] Oct 09 01:01:14.797186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:400 started Oct 09 01:01:14.800238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=121000000,duration_sec=817,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:14.801391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:14.801720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:400 - starting polling. Elapsed:0.005 Oct 09 01:01:14.804311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:14.806042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port af11de25-9b71-43af-8ce0-051a32ec945c not present in bridge br-int Oct 09 01:01:14.806367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:14.806645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['af11de25-9b71-43af-8ce0-051a32ec945c'] Oct 09 01:01:14.806955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port af11de25-9b71-43af-8ce0-051a32ec945c is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:14.811000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:400 - port information retrieved. Elapsed:0.014 Oct 09 01:01:14.811337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:400 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 09 01:01:15.137761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3be10993-e971-487b-badd-350fd2360b5c tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource Port deleted: bb19d7a6-5629-4f14-ab7a-ae0bbddba04c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:15.138145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3be10993-e971-487b-badd-350fd2360b5c tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (bb19d7a6-5629-4f14-ab7a-ae0bbddba04c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:16.798344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:401 started Oct 09 01:01:16.800736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=122000000,duration_sec=819,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:16.801323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:16.801650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:401 - starting polling. Elapsed:0.003 Oct 09 01:01:16.804219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:16.806003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port bb19d7a6-5629-4f14-ab7a-ae0bbddba04c not present in bridge br-int Oct 09 01:01:16.806325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:16.806604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['bb19d7a6-5629-4f14-ab7a-ae0bbddba04c'] Oct 09 01:01:16.806915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port bb19d7a6-5629-4f14-ab7a-ae0bbddba04c is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:16.810287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:401 - port information retrieved. Elapsed:0.012 Oct 09 01:01:16.810612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:401 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 09 01:01:18.799584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:402 started Oct 09 01:01:18.802441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=123000000,duration_sec=821,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:18.802999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:18.803353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:402 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:01:20.801122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:403 started Oct 09 01:01:20.803890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=125000000,duration_sec=823,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:20.804458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:20.804807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:403 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:01:22.451740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a33022b2-aed3-4bad-839a-7b13eb42d0cc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource Port deleted: 8fe52a88-9c39-4ea8-9d6f-ca693b1da44c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:22.452345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a33022b2-aed3-4bad-839a-7b13eb42d0cc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (8fe52a88-9c39-4ea8-9d6f-ca693b1da44c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:22.452607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a33022b2-aed3-4bad-839a-7b13eb42d0cc tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group member updated {'85d9ef2f-837e-44e1-bda5-e50dc5085b24'} Oct 09 01:01:22.801680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:404 started Oct 09 01:01:22.806455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=127000000,duration_sec=825,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:22.807021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:22.807357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:404 - starting polling. Elapsed:0.006 Oct 09 01:01:22.810052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:22.812207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8fe52a88-9c39-4ea8-9d6f-ca693b1da44c not present in bridge br-int Oct 09 01:01:22.812705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:22.812992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['8fe52a88-9c39-4ea8-9d6f-ca693b1da44c'] Oct 09 01:01:22.813315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 8fe52a88-9c39-4ea8-9d6f-ca693b1da44c is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:22.816900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:404 - port information retrieved. Elapsed:0.015 Oct 09 01:01:22.817296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:404 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 09 01:01:22.843807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f2338f29-525d-4883-8353-4a454fc6d4d5 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port deleted: c0379d91-6e4b-4a6c-895c-fc71a455dbb1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:22.844695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f2338f29-525d-4883-8353-4a454fc6d4d5 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (c0379d91-6e4b-4a6c-895c-fc71a455dbb1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:22.845522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f2338f29-525d-4883-8353-4a454fc6d4d5 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group member updated {'45da6575-619b-423b-bc04-7f831c564029'} Oct 09 01:01:24.802977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:405 started Oct 09 01:01:24.806152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=126000000,duration_sec=827,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:24.806716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:24.807052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:405 - starting polling. Elapsed:0.004 Oct 09 01:01:24.809588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:24.811331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port c0379d91-6e4b-4a6c-895c-fc71a455dbb1 not present in bridge br-int Oct 09 01:01:24.811698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:24.811977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['c0379d91-6e4b-4a6c-895c-fc71a455dbb1'] Oct 09 01:01:24.812290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port c0379d91-6e4b-4a6c-895c-fc71a455dbb1 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:24.815687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:405 - port information retrieved. Elapsed:0.013 Oct 09 01:01:24.816015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:405 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:01:26.803815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:406 started Oct 09 01:01:26.806464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=127000000,duration_sec=829,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:26.807435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:26.807807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:406 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:01:27.885607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e70be37f-8048-435f-9186-21c6b391de33 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Resource Port deleted: c41ba939-ec56-4a6f-86b0-047036daa405 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:27.886222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e70be37f-8048-435f-9186-21c6b391de33 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (c41ba939-ec56-4a6f-86b0-047036daa405), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:27.886591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-e70be37f-8048-435f-9186-21c6b391de33 tempest-ServerRescueNegativeTestJSON-1939425555 tempest-ServerRescueNegativeTestJSON-1939425555-project] Security group member updated {'85d9ef2f-837e-44e1-bda5-e50dc5085b24'} Oct 09 01:01:28.805227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:407 started Oct 09 01:01:28.807664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=129000000,duration_sec=831,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:28.808271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:28.808609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:407 - starting polling. Elapsed:0.004 Oct 09 01:01:28.811148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:28.812980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port c41ba939-ec56-4a6f-86b0-047036daa405 not present in bridge br-int Oct 09 01:01:28.813313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:28.813629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['c41ba939-ec56-4a6f-86b0-047036daa405'] Oct 09 01:01:28.813949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port c41ba939-ec56-4a6f-86b0-047036daa405 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:28.817372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:407 - port information retrieved. Elapsed:0.012 Oct 09 01:01:28.817706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:407 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:01:30.806193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:408 started Oct 09 01:01:30.809520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=130000000,duration_sec=833,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:30.810087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:30.810471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:408 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:01:30.974462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7b325a23-7d19-4ab8-bf5f-b00c5c3cfada admin admin] Resource Port deleted: d4998b74-c67b-4a9b-8a8d-658bc5efb89b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:30.977992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7b325a23-7d19-4ab8-bf5f-b00c5c3cfada admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (d4998b74-c67b-4a9b-8a8d-658bc5efb89b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:32.041023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8e02aa4e-8a8a-4295-9365-34794d9b9313 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:01:31Z,data_plane_status=None,description='',device_id='edbfc046-964c-46ac-9d30-5198c846e9b5',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=92161e7f-b2e3-4be5-9ff8-073cd2234c8e,mac_address=fa:16:3e:6b:68:70,name='',network_id=51f66c80-6e94-4ac9-ad00-6dd9246260d1,numa_affinity_policy=,project_id='28bc82345ea24b929b66fbcded2b97b7',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(92161e7f-b2e3-4be5-9ff8-073cd2234c8e),security_group_ids=set([45da6575-619b-423b-bc04-7f831c564029]),status='DOWN',updated_at=2022-10-09T01:01:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:32.042589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8e02aa4e-8a8a-4295-9365-34794d9b9313 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (92161e7f-b2e3-4be5-9ff8-073cd2234c8e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:32.043863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8e02aa4e-8a8a-4295-9365-34794d9b9313 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group member updated {'45da6575-619b-423b-bc04-7f831c564029'} Oct 09 01:01:32.696451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5e7fa104-fbde-42fa-8798-844378a577cf","delete","qr-d4998b74-c6",17,["map",[["attached-mac","fa:16:3e:77:1a:42"],["iface-id","d4998b74-c67b-4a9b-8a8d-658bc5efb89b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:32.733141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3b85c86d-75d3-4b43-98b7-eacdd0c455cb service neutron] Resource Port 92161e7f-b2e3-4be5-9ff8-073cd2234c8e updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=92161e7f-b2e3-4be5-9ff8-073cd2234c8e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=92161e7f-b2e3-4be5-9ff8-073cd2234c8e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:32.733689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3b85c86d-75d3-4b43-98b7-eacdd0c455cb service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (92161e7f-b2e3-4be5-9ff8-073cd2234c8e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:32.806672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:409 started Oct 09 01:01:32.822555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-86514d8a-f44b-48ee-a102-9df42ffa6875 admin admin] Resource Port deleted: 9cabf568-43d4-4d9d-bab1-324ec0901eb3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:32.822555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-86514d8a-f44b-48ee-a102-9df42ffa6875 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (9cabf568-43d4-4d9d-bab1-324ec0901eb3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:33.015441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3b85c86d-75d3-4b43-98b7-eacdd0c455cb service neutron] Resource Port 92161e7f-b2e3-4be5-9ff8-073cd2234c8e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=92161e7f-b2e3-4be5-9ff8-073cd2234c8e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=92161e7f-b2e3-4be5-9ff8-073cd2234c8e,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=92161e7f-b2e3-4be5-9ff8-073cd2234c8e,segment=NetworkSegment(9512762e-780c-464c-a567-4995173eb1a6),segment_id=9512762e-780c-464c-a567-4995173eb1a6)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:33.015985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3b85c86d-75d3-4b43-98b7-eacdd0c455cb service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (92161e7f-b2e3-4be5-9ff8-073cd2234c8e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:33.018458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=319000000,duration_sec=835,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:33.019517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:33.020166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:409 - starting polling. Elapsed:0.214 Oct 09 01:01:33.023058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:33.033950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9cabf568-43, col_values=(('tag', 4095),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:33.044811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef6c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:33.045468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['9cabf568-43d4-4d9d-bab1-324ec0901eb3'] Oct 09 01:01:33.045717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:33.117396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cee3c28-4029-4a77-9d77-e69cd897e421]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:33.126021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef6e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:33.126568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:409 - port information retrieved. Elapsed:0.320 Oct 09 01:01:33.127052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', '95de155f-70c1-4bf8-a59a-656fdfc1f414', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '9cabf568-43d4-4d9d-bab1-324ec0901eb3', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'d4998b74-c67b-4a9b-8a8d-658bc5efb89b'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:01:33.127559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:409 - agent port security group processed in 0.000 Oct 09 01:01:33.131088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:01:33.131450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'d4998b74-c67b-4a9b-8a8d-658bc5efb89b'} Oct 09 01:01:33.131911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:33.147960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["93312759-4e32-4b1a-94c1-c69c4dbf744e","delete","qg-9cabf568-43",14,["map",[["attached-mac","fa:16:3e:07:87:d6"],["iface-id","9cabf568-43d4-4d9d-bab1-324ec0901eb3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:33.326669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7f3518c8-af7b-46f7-8815-93d051371759 admin admin] Resource Subnet deleted: e75c4721-9fa7-417f-9e12-2a9e53f66ae7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:33.327359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7f3518c8-af7b-46f7-8815-93d051371759 admin admin] Publish callbacks [] for Subnet (e75c4721-9fa7-417f-9e12-2a9e53f66ae7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:33.497237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[3011423f-7697-4c89-a5b3-7755cd4551fa]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:33.498025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'d4998b74-c67b-4a9b-8a8d-658bc5efb89b'} removed Oct 09 01:01:33.509505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f40a3ff3-80f8-4f00-a7aa-d89e160f48d6","delete","tap95de155f-70",11,["map",[["attached-mac","fa:16:3e:ed:13:1f"],["iface-id","95de155f-70c1-4bf8-a59a-656fdfc1f414"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:33.533521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:01:33.534032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:409 - treat_devices_removed completed in 0.403 Oct 09 01:01:33.534391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:409 - ports processed. Elapsed:0.728 Oct 09 01:01:33.534781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:409 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.728 Oct 09 01:01:33.686162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a44ddf85-2da3-48ec-b9d5-609a2acd38d1 admin admin] Resource Port deleted: 95de155f-70c1-4bf8-a59a-656fdfc1f414 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:33.686768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a44ddf85-2da3-48ec-b9d5-609a2acd38d1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (95de155f-70c1-4bf8-a59a-656fdfc1f414), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:33.797427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-07fa6e00-0649-4c55-9183-447a791a6fe6 None None] Resource Port deleted: 95de155f-70c1-4bf8-a59a-656fdfc1f414 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:33.800605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-07fa6e00-0649-4c55-9183-447a791a6fe6 None None] Skipped duplicate delete event for 95de155f-70c1-4bf8-a59a-656fdfc1f414 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 09 01:01:34.236190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a44ddf85-2da3-48ec-b9d5-609a2acd38d1 admin admin] Resource Network deleted: dd937102-41e7-4629-a161-cb0fb39a0995 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:34.236790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a44ddf85-2da3-48ec-b9d5-609a2acd38d1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (dd937102-41e7-4629-a161-cb0fb39a0995), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:34.493016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Resource SecurityGroup deleted: 85d9ef2f-837e-44e1-bda5-e50dc5085b24 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:34.493398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (85d9ef2f-837e-44e1-bda5-e50dc5085b24), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:34.493887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('85d9ef2f-837e-44e1-bda5-e50dc5085b24',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:01:34.506686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('85d9ef2f-837e-44e1-bda5-e50dc5085b24',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:01:34.507234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Resource SecurityGroupRule deleted: 20570055-b831-4146-a073-046965a52d79 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:34.507704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (20570055-b831-4146-a073-046965a52d79), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:34.508102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Security group rule updated ['85d9ef2f-837e-44e1-bda5-e50dc5085b24'] Oct 09 01:01:34.508672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Resource SecurityGroupRule deleted: 6f762666-8204-414b-b7f4-de4831c2dcd9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:34.509099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6f762666-8204-414b-b7f4-de4831c2dcd9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:34.509488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Security group rule updated ['85d9ef2f-837e-44e1-bda5-e50dc5085b24'] Oct 09 01:01:34.509865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Resource SecurityGroupRule deleted: 8ea821b0-231f-4ceb-b062-ec955027e683 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:34.510208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8ea821b0-231f-4ceb-b062-ec955027e683), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:34.510525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Security group rule updated ['85d9ef2f-837e-44e1-bda5-e50dc5085b24'] Oct 09 01:01:34.510893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Resource SecurityGroupRule deleted: e999488c-ebb2-4acd-ad08-89025642e509 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:34.511230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e999488c-ebb2-4acd-ad08-89025642e509), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:34.511544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-97dce6e5-3047-4c1f-807e-db2dddb987d3 admin admin] Security group rule updated ['85d9ef2f-837e-44e1-bda5-e50dc5085b24'] Oct 09 01:01:34.807998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:410 started Oct 09 01:01:34.810399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=131000000,duration_sec=837,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:34.810968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:34.811415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:410 - starting polling. Elapsed:0.004 Oct 09 01:01:34.813773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:34.818923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef72,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:34.820621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef74,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:34.820927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:410 - port information retrieved. Elapsed:0.013 Oct 09 01:01:34.821251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'95de155f-70c1-4bf8-a59a-656fdfc1f414', '9cabf568-43d4-4d9d-bab1-324ec0901eb3'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:01:34.821569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:410 - agent port security group processed in 0.000 Oct 09 01:01:34.823524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:01:34.823848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'95de155f-70c1-4bf8-a59a-656fdfc1f414', '9cabf568-43d4-4d9d-bab1-324ec0901eb3'} Oct 09 01:01:34.824230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 9cabf568-43d4-4d9d-bab1-324ec0901eb3 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:34.824745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:34.863072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[8495eba1-9458-419f-b8ab-56771bf97a75]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:34.864242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'95de155f-70c1-4bf8-a59a-656fdfc1f414', '9cabf568-43d4-4d9d-bab1-324ec0901eb3'} removed Oct 09 01:01:34.909646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:01:34.910237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 7 from net-id = dd937102-41e7-4629-a161-cb0fb39a0995, seg-id = 697 Oct 09 01:01:34.913478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da1835,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:34.915968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363ef76,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4793}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:34.916307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:34.916605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:410 - treat_devices_removed completed in 0.093 Oct 09 01:01:34.916891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:410 - ports processed. Elapsed:0.109 Oct 09 01:01:34.917267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:410 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.109 Oct 09 01:01:35.418029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:01:35Z,description='Default security group',id=fe129bf6-63cc-41d3-9163-6b17f0f2383d,is_default=True,name='default',project_id='410212da4a794c07b30ed22cc5b7e760',revision_number=1,rules=[SecurityGroupRule(3fcfc8b5-68c0-407c-ba98-52aee2067692),SecurityGroupRule(d00d85b3-3493-4ced-b42e-8aa289955759),SecurityGroupRule(d27b09b6-15a9-484c-9826-2c1972aaacd3),SecurityGroupRule(e0ddc489-5e38-47f7-b70d-e19305e7dcec)],shared=False,stateful=True,updated_at=2022-10-09T01:01:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:35.419105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (fe129bf6-63cc-41d3-9163-6b17f0f2383d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:35.419843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:01:35Z,description=,direction='egress',ethertype='IPv4',id=3fcfc8b5-68c0-407c-ba98-52aee2067692,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe129bf6-63cc-41d3-9163-6b17f0f2383d,updated_at=2022-10-09T01:01:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:35.420307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3fcfc8b5-68c0-407c-ba98-52aee2067692), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:35.420861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Security group rule updated ['fe129bf6-63cc-41d3-9163-6b17f0f2383d'] Oct 09 01:01:35.421617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:01:35Z,description=,direction='egress',ethertype='IPv6',id=d00d85b3-3493-4ced-b42e-8aa289955759,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe129bf6-63cc-41d3-9163-6b17f0f2383d,updated_at=2022-10-09T01:01:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:35.422038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d00d85b3-3493-4ced-b42e-8aa289955759), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:35.422427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Security group rule updated ['fe129bf6-63cc-41d3-9163-6b17f0f2383d'] Oct 09 01:01:35.423489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:01:35Z,description=,direction='ingress',ethertype='IPv6',id=d27b09b6-15a9-484c-9826-2c1972aaacd3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol=,remote_address_group_id=,remote_group_id=fe129bf6-63cc-41d3-9163-6b17f0f2383d,remote_ip_prefix=,revision_number=0,security_group_id=fe129bf6-63cc-41d3-9163-6b17f0f2383d,updated_at=2022-10-09T01:01:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:35.424132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d27b09b6-15a9-484c-9826-2c1972aaacd3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:35.424492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Security group rule updated ['fe129bf6-63cc-41d3-9163-6b17f0f2383d'] Oct 09 01:01:35.425510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:01:35Z,description=,direction='ingress',ethertype='IPv4',id=e0ddc489-5e38-47f7-b70d-e19305e7dcec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol=,remote_address_group_id=,remote_group_id=fe129bf6-63cc-41d3-9163-6b17f0f2383d,remote_ip_prefix=,revision_number=0,security_group_id=fe129bf6-63cc-41d3-9163-6b17f0f2383d,updated_at=2022-10-09T01:01:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:35.426671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e0ddc489-5e38-47f7-b70d-e19305e7dcec), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:35.427067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Security group rule updated ['fe129bf6-63cc-41d3-9163-6b17f0f2383d'] Oct 09 01:01:35.572132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T01:01:35Z,description='',dns_domain=None,id=d442b64f-563d-410a-8314-ec0e04e8ccd0,mtu=1500,name='tempest-AttachVolumeShelveTestJSON-1284210602-network',project_id='410212da4a794c07b30ed22cc5b7e760',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(d442b64f-563d-410a-8314-ec0e04e8ccd0),segments=[NetworkSegment(36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5)],shared=False,status='ACTIVE',updated_at=2022-10-09T01:01:35Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:35.572682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (d442b64f-563d-410a-8314-ec0e04e8ccd0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-dee9d9f5-a39c-4c47-9485-101425990255 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d442b64f-563d-410a-8314-ec0e04e8ccd0 with segmentation id not found. Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 01:01:35.646881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 01:01:35.647917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 01:01:35.647917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 01:01:35.647917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 01:01:35.647917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d442b64f-563d-410a-8314-ec0e04e8ccd0 with segmentation id not found. Oct 09 01:01:35.647917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 01:01:35.819086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3808e844-4795-4dea-bd32-69cc2b995f97 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(85f15451-6426-4053-9a17-14691ae99fba)],cidr=172.20.0.0/28,created_at=2022-10-09T01:01:35Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=2363adb4-e3f9-485c-a97a-228855e865bf,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeShelveTestJSON-1284210602-subnet',network_id=d442b64f-563d-410a-8314-ec0e04e8ccd0,project_id='410212da4a794c07b30ed22cc5b7e760',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T01:01:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:35.819454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3808e844-4795-4dea-bd32-69cc2b995f97 admin admin] Publish callbacks [] for Subnet (2363adb4-e3f9-485c-a97a-228855e865bf), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:36.316782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9a602be8-20ef-4c65-b3b0-31be0777709c None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:01:35Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d442b64f-563d-410a-8314-ec0e04e8ccd0',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f3dc5370-39c5-4415-92ad-c8dc6c6bb65b,mac_address=fa:16:3e:c8:af:85,name='',network_id=d442b64f-563d-410a-8314-ec0e04e8ccd0,numa_affinity_policy=,project_id='410212da4a794c07b30ed22cc5b7e760',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f3dc5370-39c5-4415-92ad-c8dc6c6bb65b),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:01:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:36.317174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9a602be8-20ef-4c65-b3b0-31be0777709c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f3dc5370-39c5-4415-92ad-c8dc6c6bb65b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:36.555275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9a602be8-20ef-4c65-b3b0-31be0777709c None None] Resource Port f3dc5370-39c5-4415-92ad-c8dc6c6bb65b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f3dc5370-39c5-4415-92ad-c8dc6c6bb65b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f3dc5370-39c5-4415-92ad-c8dc6c6bb65b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f3dc5370-39c5-4415-92ad-c8dc6c6bb65b,segment=NetworkSegment(36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5),segment_id=36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:36.556742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9a602be8-20ef-4c65-b3b0-31be0777709c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f3dc5370-39c5-4415-92ad-c8dc6c6bb65b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:36.641334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ea7cb6d0-4485-4b47-8b42-2eb73eda616c admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:01:36Z,data_plane_status=None,description='',device_id='f7fc834f-b827-462f-8575-fc996402b3f1',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=bd00ba1d-bc1e-47c3-987d-b5e22a6cc264,mac_address=fa:16:3e:b3:01:1f,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(bd00ba1d-bc1e-47c3-987d-b5e22a6cc264),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:01:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:36.642036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ea7cb6d0-4485-4b47-8b42-2eb73eda616c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bd00ba1d-bc1e-47c3-987d-b5e22a6cc264), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:36.679057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["471a03f9-b1e4-4a67-95c1-5438c820ac5e","insert","tapf3dc5370-39",["set",[]],["map",[["attached-mac","fa:16:3e:c8:af:85"],["iface-id","f3dc5370-39c5-4415-92ad-c8dc6c6bb65b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:36.688076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["471a03f9-b1e4-4a67-95c1-5438c820ac5e","old",null,["set",[]],null],["","new","tapf3dc5370-39",24,["map",[["attached-mac","fa:16:3e:c8:af:85"],["iface-id","f3dc5370-39c5-4415-92ad-c8dc6c6bb65b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:36.809272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:411 started Oct 09 01:01:36.812287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=133000000,duration_sec=839,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:36.812887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:36.813354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:411 - starting polling. Elapsed:0.004 Oct 09 01:01:36.816188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:36.820108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:411 - port information retrieved. Elapsed:0.011 Oct 09 01:01:36.820447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b'}, 'removed': set(), 'updated': {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:01:36.821009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d442b64f-563d-410a-8314-ec0e04e8ccd0', 'network_id': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'port_id': 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'mac_address': 'fa:16:3e:c8:af:85', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2363adb4-e3f9-485c-a97a-228855e865bf', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:01:36.824200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: f3dc5370-39c5-4415-92ad-c8dc6c6bb65b {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:01:36.824581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f3dc5370-39c5-4415-92ad-c8dc6c6bb65b updated. Details: {'device': 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d442b64f-563d-410a-8314-ec0e04e8ccd0', 'network_id': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'port_id': 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'mac_address': 'fa:16:3e:c8:af:85', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2363adb4-e3f9-485c-a97a-228855e865bf', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 01:01:36.824921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 10 as local vlan for net-id=d442b64f-563d-410a-8314-ec0e04e8ccd0, seg-id=655 Oct 09 01:01:36.829130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da1837,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4751), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:36.831386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363ef7a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4106)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4751}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:36.832980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf3dc5370-39, col_values=(('tag', 10),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:36.833587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapf3dc5370-39, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:36.834187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapf3dc5370-39, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:36.840771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf3dc5370-39, col_values=(('other_config', {'net_uuid': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '655'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:36.847407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef7c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:36.847813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:411 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.027 Oct 09 01:01:36.848303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:01:36.848609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b'} Oct 09 01:01:36.849912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:01:36.850202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:01:36.854615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:36.892591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[2002b63a-1f51-4721-8553-2c4c0524ceef]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:36.893260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:411 - agent port security group processed in 0.072 Oct 09 01:01:36.894094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for f3dc5370-39c5-4415-92ad-c8dc6c6bb65b to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:01:37.067789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['f3dc5370-39c5-4415-92ad-c8dc6c6bb65b'] and devices down [] completed. Oct 09 01:01:37.068107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:411 - ports processed. Elapsed:0.259 Oct 09 01:01:37.068442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:411 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.259 Oct 09 01:01:37.121949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port f3dc5370-39c5-4415-92ad-c8dc6c6bb65b updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:37.122336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f3dc5370-39c5-4415-92ad-c8dc6c6bb65b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:38.204097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6183235-7395-4bd2-8a46-3aeb18fba50e admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:01:37Z,data_plane_status=None,description='',device_id='f7fc834f-b827-462f-8575-fc996402b3f1',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4c3a97ee-facb-4248-818b-3d6676479188,mac_address=fa:16:3e:7c:db:ac,name='',network_id=d442b64f-563d-410a-8314-ec0e04e8ccd0,numa_affinity_policy=,project_id='410212da4a794c07b30ed22cc5b7e760',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4c3a97ee-facb-4248-818b-3d6676479188),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:01:37Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:38.205270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6183235-7395-4bd2-8a46-3aeb18fba50e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4c3a97ee-facb-4248-818b-3d6676479188), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:38.463360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c0b0f899-ecf7-42f6-bab2-e51ca338b7af None None] Resource Port bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=bd00ba1d-bc1e-47c3-987d-b5e22a6cc264,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=bd00ba1d-bc1e-47c3-987d-b5e22a6cc264,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:38.464055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c0b0f899-ecf7-42f6-bab2-e51ca338b7af None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bd00ba1d-bc1e-47c3-987d-b5e22a6cc264), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:38.635089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6183235-7395-4bd2-8a46-3aeb18fba50e admin admin] Received resource Port update without any changes: 4c3a97ee-facb-4248-818b-3d6676479188 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 01:01:38.698189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c0b0f899-ecf7-42f6-bab2-e51ca338b7af None None] Resource Port bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=bd00ba1d-bc1e-47c3-987d-b5e22a6cc264,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=bd00ba1d-bc1e-47c3-987d-b5e22a6cc264,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=bd00ba1d-bc1e-47c3-987d-b5e22a6cc264,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:38.698841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c0b0f899-ecf7-42f6-bab2-e51ca338b7af None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bd00ba1d-bc1e-47c3-987d-b5e22a6cc264), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:38.809840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:412 started Oct 09 01:01:38.813221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=134000000,duration_sec=841,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:38.814014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:38.814589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:412 - starting polling. Elapsed:0.005 Oct 09 01:01:38.819986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:38.824630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:412 - port information retrieved. Elapsed:0.014 Oct 09 01:01:38.825258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'e117ae0c-3834-457d-833e-82227f33c129', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:01:38.826547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d442b64f-563d-410a-8314-ec0e04e8ccd0', 'network_id': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'port_id': 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'mac_address': 'fa:16:3e:c8:af:85', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2363adb4-e3f9-485c-a97a-228855e865bf', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:01:38.831570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: f3dc5370-39c5-4415-92ad-c8dc6c6bb65b {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:01:38.833546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f3dc5370-39c5-4415-92ad-c8dc6c6bb65b updated. Details: {'device': 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d442b64f-563d-410a-8314-ec0e04e8ccd0', 'network_id': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'port_id': 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'mac_address': 'fa:16:3e:c8:af:85', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2363adb4-e3f9-485c-a97a-228855e865bf', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 09 01:01:38.834914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf3dc5370-39, col_values=(('tag', 10),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:38.836224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapf3dc5370-39, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:38.836904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapf3dc5370-39, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:38.837813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:01:38.839545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf3dc5370-39, col_values=(('other_config', {'net_uuid': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '655', 'tag': '10'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:38.841716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:01:38.845758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef80,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:38.846244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:412 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.020 Oct 09 01:01:38.847002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:01:38.847673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:01:38.849728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:01:38.850454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:01:38.868564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:38.945140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7fb582-06b5-45e0-be45-2e5383ce0690]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:38.946121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:412 - agent port security group processed in 0.120 Oct 09 01:01:38.947043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for f3dc5370-39c5-4415-92ad-c8dc6c6bb65b to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:01:39.259269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['f3dc5370-39c5-4415-92ad-c8dc6c6bb65b'] and devices down [] completed. Oct 09 01:01:39.260180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:412 - ports processed. Elapsed:0.450 Oct 09 01:01:39.260180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:412 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.450 Oct 09 01:01:39.388731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["911a00f8-37a9-45d8-8762-bd80acb50a8c","insert","qr-4c3a97ee-fa",["set",[]],["map",[["attached-mac","fa:16:3e:7c:db:ac"],["iface-id","4c3a97ee-facb-4248-818b-3d6676479188"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:39.423382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["911a00f8-37a9-45d8-8762-bd80acb50a8c","old",null,["set",[]],null],["","new","qr-4c3a97ee-fa",25,["map",[["attached-mac","fa:16:3e:7c:db:ac"],["iface-id","4c3a97ee-facb-4248-818b-3d6676479188"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:39.586314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fc13ccdb-1afa-43b2-b404-36754a4167a9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:01:39Z,description='tempest-description--1584434030',id=14302cb8-4374-490f-af67-f2d863cd7361,is_default=False,name='tempest-securitygroup--513233236',project_id='410212da4a794c07b30ed22cc5b7e760',revision_number=1,rules=[SecurityGroupRule(79084672-2c65-4057-b3d4-85dbbb6d0465),SecurityGroupRule(a8421430-bf33-4aa8-8264-41ee0fc47b80)],shared=False,stateful=True,updated_at=2022-10-09T01:01:39Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:39.586719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fc13ccdb-1afa-43b2-b404-36754a4167a9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (14302cb8-4374-490f-af67-f2d863cd7361), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:39.587356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fc13ccdb-1afa-43b2-b404-36754a4167a9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:01:39Z,description=,direction='egress',ethertype='IPv6',id=79084672-2c65-4057-b3d4-85dbbb6d0465,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=14302cb8-4374-490f-af67-f2d863cd7361,updated_at=2022-10-09T01:01:39Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:39.587736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fc13ccdb-1afa-43b2-b404-36754a4167a9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (79084672-2c65-4057-b3d4-85dbbb6d0465), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:39.591990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fc13ccdb-1afa-43b2-b404-36754a4167a9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['14302cb8-4374-490f-af67-f2d863cd7361'] Oct 09 01:01:39.592741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fc13ccdb-1afa-43b2-b404-36754a4167a9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:01:39Z,description=,direction='egress',ethertype='IPv4',id=a8421430-bf33-4aa8-8264-41ee0fc47b80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=14302cb8-4374-490f-af67-f2d863cd7361,updated_at=2022-10-09T01:01:39Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:39.593162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fc13ccdb-1afa-43b2-b404-36754a4167a9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a8421430-bf33-4aa8-8264-41ee0fc47b80), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:39.593502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fc13ccdb-1afa-43b2-b404-36754a4167a9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['14302cb8-4374-490f-af67-f2d863cd7361'] Oct 09 01:01:39.719447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b5b8db3a-1a60-48bd-a31a-a5a90bde0512 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:01:39Z,description='',direction='ingress',ethertype='IPv4',id=6db815b6-4cee-42cc-9e42-6f2c7584013d,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='410212da4a794c07b30ed22cc5b7e760',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=14302cb8-4374-490f-af67-f2d863cd7361,updated_at=2022-10-09T01:01:39Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:39.719447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b5b8db3a-1a60-48bd-a31a-a5a90bde0512 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6db815b6-4cee-42cc-9e42-6f2c7584013d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:39.719447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b5b8db3a-1a60-48bd-a31a-a5a90bde0512 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['14302cb8-4374-490f-af67-f2d863cd7361'] Oct 09 01:01:39.861570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cdf7b303-f298-4643-a98d-a220d9a1e75d tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:01:39Z,description='',direction='ingress',ethertype='IPv4',id=f42b57e1-6772-477d-bc2e-256f0a6b8a29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=14302cb8-4374-490f-af67-f2d863cd7361,updated_at=2022-10-09T01:01:39Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:39.861570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cdf7b303-f298-4643-a98d-a220d9a1e75d tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f42b57e1-6772-477d-bc2e-256f0a6b8a29), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:39.861570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cdf7b303-f298-4643-a98d-a220d9a1e75d tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['14302cb8-4374-490f-af67-f2d863cd7361'] Oct 09 01:01:39.930509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["db03cce3-70f6-4763-82d0-25dd4977f357","insert","qg-bd00ba1d-bc",["set",[]],["map",[["attached-mac","fa:16:3e:b3:01:1f"],["iface-id","bd00ba1d-bc1e-47c3-987d-b5e22a6cc264"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:39.946361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["db03cce3-70f6-4763-82d0-25dd4977f357","old",null,["set",[]],null],["","new","qg-bd00ba1d-bc",26,["map",[["attached-mac","fa:16:3e:b3:01:1f"],["iface-id","bd00ba1d-bc1e-47c3-987d-b5e22a6cc264"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:40.088685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 92161e7f-b2e3-4be5-9ff8-073cd2234c8e updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:40.089059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (92161e7f-b2e3-4be5-9ff8-073cd2234c8e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:40.367011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d01e3900-a3aa-4f8a-a646-47ac5c1aaaec tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:01:40Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0581945e-4b8a-4e1b-825c-669088720dab,mac_address=fa:16:3e:f0:18:cf,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0581945e-4b8a-4e1b-825c-669088720dab),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T01:01:40Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:40.368177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d01e3900-a3aa-4f8a-a646-47ac5c1aaaec tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0581945e-4b8a-4e1b-825c-669088720dab), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:40.755647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-d01e3900-a3aa-4f8a-a646-47ac5c1aaaec tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource Port 0581945e-4b8a-4e1b-825c-669088720dab updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '214143bc-7e66-4a74-9bff-d6e4f197282d'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:40.756157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-d01e3900-a3aa-4f8a-a646-47ac5c1aaaec tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0581945e-4b8a-4e1b-825c-669088720dab), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:40.810370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:413 started Oct 09 01:01:40.813046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=134000000,duration_sec=843,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:40.813617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:40.814143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:413 - starting polling. Elapsed:0.004 Oct 09 01:01:40.817540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:40.820984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:413 - port information retrieved. Elapsed:0.011 Oct 09 01:01:40.821313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '4c3a97ee-facb-4248-818b-3d6676479188', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': {'4c3a97ee-facb-4248-818b-3d6676479188', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:01:40.821962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:01:37Z,data_plane_status=None,description='',device_id='f7fc834f-b827-462f-8575-fc996402b3f1',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4c3a97ee-facb-4248-818b-3d6676479188,mac_address=fa:16:3e:7c:db:ac,name='',network_id=d442b64f-563d-410a-8314-ec0e04e8ccd0,numa_affinity_policy=,project_id='410212da4a794c07b30ed22cc5b7e760',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(4c3a97ee-facb-4248-818b-3d6676479188),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:01:38Z) is not bound. Oct 09 01:01:40.822490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', 'device_id': 'f7fc834f-b827-462f-8575-fc996402b3f1', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', 'mac_address': 'fa:16:3e:b3:01:1f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.236'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:01:40.825858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 4c3a97ee-facb-4248-818b-3d6676479188 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:01:40.826124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device 4c3a97ee-facb-4248-818b-3d6676479188 not defined on plugin or binding failed Oct 09 01:01:40.826586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:01:40.826895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 updated. Details: {'device': 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', 'device_id': 'f7fc834f-b827-462f-8575-fc996402b3f1', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', 'mac_address': 'fa:16:3e:b3:01:1f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.236'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:01:40.827841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-bd00ba1d-bc, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:40.828258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-bd00ba1d-bc, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:40.828685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-bd00ba1d-bc, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:40.834960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-bd00ba1d-bc, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:40.842761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef84,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:40.843112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:413 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.021 Oct 09 01:01:40.843460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 2 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:01:40.843783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'4c3a97ee-facb-4248-818b-3d6676479188', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264'} Oct 09 01:01:40.845298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:01:40.845589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:01:40.850468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:40.889613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4fb87c-21f1-4161-96f5-874560ae76b7]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:40.890240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:413 - agent port security group processed in 0.069 Oct 09 01:01:40.891036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:01:41.059904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['bd00ba1d-bc1e-47c3-987d-b5e22a6cc264'] and devices down [] completed. Oct 09 01:01:41.060422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:413 - ports processed. Elapsed:0.250 Oct 09 01:01:41.060858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:413 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.251 Oct 09 01:01:41.114653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=bd00ba1d-bc1e-47c3-987d-b5e22a6cc264,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=bd00ba1d-bc1e-47c3-987d-b5e22a6cc264,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:41.115031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (bd00ba1d-bc1e-47c3-987d-b5e22a6cc264), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:42.066210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 92161e7f-b2e3-4be5-9ff8-073cd2234c8e updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:42.067369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (92161e7f-b2e3-4be5-9ff8-073cd2234c8e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:42.486385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6649cfb9-0346-4c32-ac45-80a4f9b4ea05 None None] Resource Port 4c3a97ee-facb-4248-818b-3d6676479188 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=4c3a97ee-facb-4248-818b-3d6676479188,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4c3a97ee-facb-4248-818b-3d6676479188,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:42.486767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6649cfb9-0346-4c32-ac45-80a4f9b4ea05 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4c3a97ee-facb-4248-818b-3d6676479188), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:42.730597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6649cfb9-0346-4c32-ac45-80a4f9b4ea05 None None] Resource Port 4c3a97ee-facb-4248-818b-3d6676479188 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4c3a97ee-facb-4248-818b-3d6676479188,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4c3a97ee-facb-4248-818b-3d6676479188,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4c3a97ee-facb-4248-818b-3d6676479188,segment=NetworkSegment(36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5),segment_id=36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:42.730982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6649cfb9-0346-4c32-ac45-80a4f9b4ea05 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4c3a97ee-facb-4248-818b-3d6676479188), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:42.811070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:414 started Oct 09 01:01:42.813981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=135000000,duration_sec=845,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:42.814809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:42.815350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:414 - starting polling. Elapsed:0.004 Oct 09 01:01:42.818911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:42.824621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:414 - port information retrieved. Elapsed:0.014 Oct 09 01:01:42.824960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '4c3a97ee-facb-4248-818b-3d6676479188', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'4c3a97ee-facb-4248-818b-3d6676479188', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:01:42.825554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '4c3a97ee-facb-4248-818b-3d6676479188', 'device_id': 'f7fc834f-b827-462f-8575-fc996402b3f1', 'network_id': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'port_id': '4c3a97ee-facb-4248-818b-3d6676479188', 'mac_address': 'fa:16:3e:7c:db:ac', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2363adb4-e3f9-485c-a97a-228855e865bf', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:01:42.826035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', 'device_id': 'f7fc834f-b827-462f-8575-fc996402b3f1', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', 'mac_address': 'fa:16:3e:b3:01:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.236'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:01:42.830503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 4c3a97ee-facb-4248-818b-3d6676479188 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:01:42.831007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 4c3a97ee-facb-4248-818b-3d6676479188 updated. Details: {'device': '4c3a97ee-facb-4248-818b-3d6676479188', 'device_id': 'f7fc834f-b827-462f-8575-fc996402b3f1', 'network_id': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'port_id': '4c3a97ee-facb-4248-818b-3d6676479188', 'mac_address': 'fa:16:3e:7c:db:ac', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2363adb4-e3f9-485c-a97a-228855e865bf', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 09 01:01:42.833851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4c3a97ee-fa, col_values=(('tag', 10),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:42.834284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-4c3a97ee-fa, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:42.834717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-4c3a97ee-fa, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:42.841568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4c3a97ee-fa, col_values=(('other_config', {'net_uuid': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '655'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:42.853445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef88,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:42.853778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:01:42.854100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 updated. Details: {'device': 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', 'device_id': 'f7fc834f-b827-462f-8575-fc996402b3f1', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', 'mac_address': 'fa:16:3e:b3:01:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.236'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:01:42.855319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-bd00ba1d-bc, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:42.855826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-bd00ba1d-bc, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:42.856530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-bd00ba1d-bc, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:42.857079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:01:42.857799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-bd00ba1d-bc, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:42.858424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:01:42.860935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef8a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:42.861285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:414 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.036 Oct 09 01:01:42.861623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:01:42.861903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:01:42.863720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:01:42.863994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:01:42.870623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:42.914768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[91089378-9761-42ab-baab-da79907cb440]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:42.915374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:414 - agent port security group processed in 0.090 Oct 09 01:01:42.916279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 4c3a97ee-facb-4248-818b-3d6676479188 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:01:42.916596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:01:43.197642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 4c3a97ee-facb-4248-818b-3d6676479188 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:43.198238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (4c3a97ee-facb-4248-818b-3d6676479188), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:43.280575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['4c3a97ee-facb-4248-818b-3d6676479188', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264'] and devices down [] completed. Oct 09 01:01:43.281028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:414 - ports processed. Elapsed:0.470 Oct 09 01:01:43.281376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:414 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.470 Oct 09 01:01:44.811971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:415 started Oct 09 01:01:44.814494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=135000000,duration_sec=847,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:44.815060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:44.815398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:415 - starting polling. Elapsed:0.004 Oct 09 01:01:44.818517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:44.822078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:415 - port information retrieved. Elapsed:0.010 Oct 09 01:01:44.822407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '4c3a97ee-facb-4248-818b-3d6676479188', 'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'4c3a97ee-facb-4248-818b-3d6676479188'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:01:44.822967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '4c3a97ee-facb-4248-818b-3d6676479188', 'device_id': 'f7fc834f-b827-462f-8575-fc996402b3f1', 'network_id': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'port_id': '4c3a97ee-facb-4248-818b-3d6676479188', 'mac_address': 'fa:16:3e:7c:db:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2363adb4-e3f9-485c-a97a-228855e865bf', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:01:44.826308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 4c3a97ee-facb-4248-818b-3d6676479188 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:01:44.826631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 4c3a97ee-facb-4248-818b-3d6676479188 updated. Details: {'device': '4c3a97ee-facb-4248-818b-3d6676479188', 'device_id': 'f7fc834f-b827-462f-8575-fc996402b3f1', 'network_id': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'port_id': '4c3a97ee-facb-4248-818b-3d6676479188', 'mac_address': 'fa:16:3e:7c:db:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2363adb4-e3f9-485c-a97a-228855e865bf', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 09 01:01:44.827672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4c3a97ee-fa, col_values=(('tag', 10),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:44.828099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-4c3a97ee-fa, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:44.828499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-4c3a97ee-fa, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:44.828939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:01:44.829693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4c3a97ee-fa, col_values=(('other_config', {'net_uuid': 'd442b64f-563d-410a-8314-ec0e04e8ccd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '655', 'tag': '10'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:44.830358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:01:44.833225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef8e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:44.833563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:415 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.011 Oct 09 01:01:44.834174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:01:44.834467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:01:44.835607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:01:44.835894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:01:44.840063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:44.890216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[8280bbbf-a63a-4b08-a161-cbd32c961b25]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:44.891025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:415 - agent port security group processed in 0.068 Oct 09 01:01:44.891867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 4c3a97ee-facb-4248-818b-3d6676479188 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:01:45.183867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['4c3a97ee-facb-4248-818b-3d6676479188'] and devices down [] completed. Oct 09 01:01:45.184279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:415 - ports processed. Elapsed:0.372 Oct 09 01:01:45.184618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:415 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.373 Oct 09 01:01:45.558283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51249011-8b53-42ac-aa2c-4026996326d0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:01:45Z,data_plane_status=None,description='',device_id='98a78205-334d-469d-8eb4-26c151df1616',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a48d8008-24c8-488e-9a77-3b3d2c3b71b4,mac_address=fa:16:3e:b4:e9:8a,name='',network_id=d442b64f-563d-410a-8314-ec0e04e8ccd0,numa_affinity_policy=,project_id='410212da4a794c07b30ed22cc5b7e760',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a48d8008-24c8-488e-9a77-3b3d2c3b71b4),security_group_ids=set([14302cb8-4374-490f-af67-f2d863cd7361]),status='DOWN',updated_at=2022-10-09T01:01:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:45.559148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51249011-8b53-42ac-aa2c-4026996326d0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:45.559807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51249011-8b53-42ac-aa2c-4026996326d0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group member updated {'14302cb8-4374-490f-af67-f2d863cd7361'} Oct 09 01:01:46.631131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2677a99-1dbc-4c3d-bc3c-b9de30911884 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:01:45Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b6e09be5-fa81-42d1-9e3d-4510f834a534,mac_address=fa:16:3e:f8:bb:5b,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b6e09be5-fa81-42d1-9e3d-4510f834a534),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T01:01:46Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:01:46.631788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2677a99-1dbc-4c3d-bc3c-b9de30911884 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (b6e09be5-fa81-42d1-9e3d-4510f834a534), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:46.812597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:416 started Oct 09 01:01:46.816254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=136000000,duration_sec=849,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:46.817066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:46.817456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:416 - starting polling. Elapsed:0.005 Oct 09 01:01:46.821356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:46.825166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:416 - port information retrieved. Elapsed:0.013 Oct 09 01:01:46.825512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:416 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:01:47.501757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-30e111e9-90ed-4c50-ae89-f8188a51b894 service neutron] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=a48d8008-24c8-488e-9a77-3b3d2c3b71b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=a48d8008-24c8-488e-9a77-3b3d2c3b71b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:47.502143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-30e111e9-90ed-4c50-ae89-f8188a51b894 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:48.219103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b2677a99-1dbc-4c3d-bc3c-b9de30911884 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port b6e09be5-fa81-42d1-9e3d-4510f834a534 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'eec83451-fbfa-4650-a29b-756ef87309c2'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:48.219766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b2677a99-1dbc-4c3d-bc3c-b9de30911884 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (b6e09be5-fa81-42d1-9e3d-4510f834a534), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:48.778795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-30e111e9-90ed-4c50-ae89-f8188a51b894 service neutron] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a48d8008-24c8-488e-9a77-3b3d2c3b71b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a48d8008-24c8-488e-9a77-3b3d2c3b71b4,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a48d8008-24c8-488e-9a77-3b3d2c3b71b4,segment=NetworkSegment(36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5),segment_id=36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:48.779428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-30e111e9-90ed-4c50-ae89-f8188a51b894 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:48.813185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:417 started Oct 09 01:01:48.817991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=137000000,duration_sec=851,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:48.818717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:48.819158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:417 - starting polling. Elapsed:0.006 Oct 09 01:01:48.833922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:48.853727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:417 - port information retrieved. Elapsed:0.041 Oct 09 01:01:48.854075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:417 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.041 Oct 09 01:01:48.968464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8ffb7138-95f1-43b9-9aa8-231d3e416417 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource Port deleted: 0b9a0bca-1f0d-4dc1-a233-b41357e21184 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:48.969062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8ffb7138-95f1-43b9-9aa8-231d3e416417 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (0b9a0bca-1f0d-4dc1-a233-b41357e21184), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:48.969477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8ffb7138-95f1-43b9-9aa8-231d3e416417 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group member updated {'2a9a84d8-6b62-42b6-be63-f330ce004a76'} Oct 09 01:01:50.814398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:418 started Oct 09 01:01:50.817972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=138000000,duration_sec=853,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:50.818993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:50.820299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:418 - starting polling. Elapsed:0.006 Oct 09 01:01:50.822959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:50.825094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 0b9a0bca-1f0d-4dc1-a233-b41357e21184 not present in bridge br-int Oct 09 01:01:50.825489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:50.826028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['0b9a0bca-1f0d-4dc1-a233-b41357e21184'] Oct 09 01:01:50.826419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 0b9a0bca-1f0d-4dc1-a233-b41357e21184 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:50.839141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:418 - port information retrieved. Elapsed:0.025 Oct 09 01:01:50.841200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:418 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.027 Oct 09 01:01:51.522033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroup deleted: 2a9a84d8-6b62-42b6-be63-f330ce004a76 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:51.522408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (2a9a84d8-6b62-42b6-be63-f330ce004a76), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:51.522862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2a9a84d8-6b62-42b6-be63-f330ce004a76',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:01:51.541528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2a9a84d8-6b62-42b6-be63-f330ce004a76',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:01:51.542002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroupRule deleted: 59cb45b2-5a88-4e51-851f-4575b693b139 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:51.542361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (59cb45b2-5a88-4e51-851f-4575b693b139), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:51.542697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['2a9a84d8-6b62-42b6-be63-f330ce004a76'] Oct 09 01:01:51.543082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroupRule deleted: 8b6501a8-5653-4675-a246-cac24386b058 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:51.543719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8b6501a8-5653-4675-a246-cac24386b058), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:51.544280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['2a9a84d8-6b62-42b6-be63-f330ce004a76'] Oct 09 01:01:51.544870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroupRule deleted: b0d35072-a134-46a4-b377-a66c1f6d69de {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:51.545277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b0d35072-a134-46a4-b377-a66c1f6d69de), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:51.545665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['2a9a84d8-6b62-42b6-be63-f330ce004a76'] Oct 09 01:01:51.546280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource SecurityGroupRule deleted: 8238b067-b155-4906-9f74-9082760e357e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:51.546685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8238b067-b155-4906-9f74-9082760e357e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:51.547090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b9026682-3f2c-48e7-bcc6-11b2a81697c8 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Security group rule updated ['2a9a84d8-6b62-42b6-be63-f330ce004a76'] Oct 09 01:01:51.923925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1d74dc51-ed92-450a-9572-12b75d38fbf5 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Resource Port deleted: 091534a1-925c-45ea-b86d-37c86c13337d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:51.926505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1d74dc51-ed92-450a-9572-12b75d38fbf5 tempest-AttachVolumeTestJSON-1644302101 tempest-AttachVolumeTestJSON-1644302101-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (091534a1-925c-45ea-b86d-37c86c13337d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:52.091514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:52.091949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:52.817469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:419 started Oct 09 01:01:52.819938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=141000000,duration_sec=855,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:52.820512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:52.820851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:419 - starting polling. Elapsed:0.004 Oct 09 01:01:52.823461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:52.825229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 091534a1-925c-45ea-b86d-37c86c13337d not present in bridge br-int Oct 09 01:01:52.825562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:52.825852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['091534a1-925c-45ea-b86d-37c86c13337d'] Oct 09 01:01:52.826175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 091534a1-925c-45ea-b86d-37c86c13337d is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:52.829574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:419 - port information retrieved. Elapsed:0.012 Oct 09 01:01:52.829910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:419 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:01:54.072379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:01:54.073006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:54.818865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:420 started Oct 09 01:01:54.821310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=142000000,duration_sec=857,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:54.821900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:54.822258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:420 - starting polling. Elapsed:0.004 Oct 09 01:01:54.824851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:54.828305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:420 - port information retrieved. Elapsed:0.010 Oct 09 01:01:54.828817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:420 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:01:56.636313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-65202161-fc98-4e6d-bdfd-9a1551f6018b admin admin] Resource Port deleted: fad9b6dc-752f-4312-9fb4-3e5be2dec7ea {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:56.636932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-65202161-fc98-4e6d-bdfd-9a1551f6018b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (fad9b6dc-752f-4312-9fb4-3e5be2dec7ea), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:56.820260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:421 started Oct 09 01:01:56.822661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=144000000,duration_sec=859,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:56.823256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:56.823609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:421 - starting polling. Elapsed:0.004 Oct 09 01:01:56.826150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:56.830014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fad9b6dc-75, col_values=(('tag', 4095),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:56.850619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363ef9c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:56.851016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['fad9b6dc-752f-4312-9fb4-3e5be2dec7ea'] Oct 09 01:01:56.851458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:56.892246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a8ecf5-4a3b-44da-88bb-dc2474b7b0c7]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:56.908136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:421 - port information retrieved. Elapsed:0.088 Oct 09 01:01:56.909311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:421 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.089 Oct 09 01:01:58.626444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c47ab95c-3839-4f6f-b674-c16f6f84cb25","delete","qr-fad9b6dc-75",8,["map",[["attached-mac","fa:16:3e:7e:9e:05"],["iface-id","fad9b6dc-752f-4312-9fb4-3e5be2dec7ea"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:58.634390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6f2e226-3877-424f-bb8e-8048563133a1 admin admin] Resource Port deleted: 52c9f24a-41b9-4582-897b-a9388e078cc4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:58.639558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6f2e226-3877-424f-bb8e-8048563133a1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (52c9f24a-41b9-4582-897b-a9388e078cc4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:58.821239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:422 started Oct 09 01:01:58.926370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363ef9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=239000000,duration_sec=861,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:58.927266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:01:58.927874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:422 - starting polling. Elapsed:0.107 Oct 09 01:01:58.930514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:58.933912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52c9f24a-41, col_values=(('tag', 4095),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:01:58.954349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363efa0,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:58.954990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['52c9f24a-41b9-4582-897b-a9388e078cc4'] Oct 09 01:01:58.955612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:01:58.998936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[125e0d79-1a51-43e7-bd0a-a5ef3c2aee7a]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:01:59.008270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363efa2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:01:59.008675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:422 - port information retrieved. Elapsed:0.188 Oct 09 01:01:59.009224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', '52c9f24a-41b9-4582-897b-a9388e078cc4', 'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'a12e3d11-0a2d-4089-8565-84afac1050b3', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:01:59.009561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:422 - agent port security group processed in 0.000 Oct 09 01:01:59.015072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:01:59.015461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea'} Oct 09 01:01:59.017170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port fad9b6dc-752f-4312-9fb4-3e5be2dec7ea is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:01:59.017577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'fad9b6dc-752f-4312-9fb4-3e5be2dec7ea'} removed Oct 09 01:01:59.064625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:01:59.065179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:01:59.065624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:422 - treat_devices_removed completed in 0.050 Oct 09 01:01:59.066208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:422 - ports processed. Elapsed:0.245 Oct 09 01:01:59.066639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:422 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.246 Oct 09 01:01:59.252025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-abacbe26-db4a-4380-8694-7129a93b8f01 admin admin] Resource Subnet deleted: 9ba14a53-0198-4c1f-9001-da2b49d70087 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:59.252697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-abacbe26-db4a-4380-8694-7129a93b8f01 admin admin] Publish callbacks [] for Subnet (9ba14a53-0198-4c1f-9001-da2b49d70087), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:59.425188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ad0b9338-a894-4a83-9455-1a47e72377a2","delete","tapa12e3d11-0a",6,["map",[["attached-mac","fa:16:3e:2f:ce:5b"],["iface-id","a12e3d11-0a2d-4089-8565-84afac1050b3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:59.561465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9b3d3b1f-6d47-477a-b6fd-5d9b854a3ae0","delete","qg-52c9f24a-41",9,["map",[["attached-mac","fa:16:3e:db:b9:7d"],["iface-id","52c9f24a-41b9-4582-897b-a9388e078cc4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:01:59.716851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5e7b1dff-e85b-4e56-a3d9-a795bd2b7993 admin admin] Resource Port deleted: a12e3d11-0a2d-4089-8565-84afac1050b3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:59.717456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5e7b1dff-e85b-4e56-a3d9-a795bd2b7993 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (a12e3d11-0a2d-4089-8565-84afac1050b3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:01:59.845610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ed0a3dcd-fab7-42e3-ab18-1739de0f3124 None None] Resource Port deleted: a12e3d11-0a2d-4089-8565-84afac1050b3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:01:59.847983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ed0a3dcd-fab7-42e3-ab18-1739de0f3124 None None] Skipped duplicate delete event for a12e3d11-0a2d-4089-8565-84afac1050b3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 09 01:02:00.042554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5e7b1dff-e85b-4e56-a3d9-a795bd2b7993 admin admin] Resource Network deleted: 93a9ba3d-37f0-48ce-9786-b421e5404102 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:00.043052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5e7b1dff-e85b-4e56-a3d9-a795bd2b7993 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (93a9ba3d-37f0-48ce-9786-b421e5404102), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:00.111348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-210a5c50-dcb7-402c-bb49-450743bf98b0 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port deleted: bf1ecde5-a035-439a-96b4-f7a4880b70e4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:00.111957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-210a5c50-dcb7-402c-bb49-450743bf98b0 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (bf1ecde5-a035-439a-96b4-f7a4880b70e4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:00.112612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-210a5c50-dcb7-402c-bb49-450743bf98b0 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group member updated {'0ea9187f-2101-4156-8867-3f35f5d56794'} Oct 09 01:02:00.348254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Resource SecurityGroup deleted: 8847f164-307d-42d0-9040-ccfe75a13f21 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:00.349998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (8847f164-307d-42d0-9040-ccfe75a13f21), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:00.350806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8847f164-307d-42d0-9040-ccfe75a13f21',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:00.366971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8847f164-307d-42d0-9040-ccfe75a13f21',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:00.367451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Resource SecurityGroupRule deleted: 03c65f21-9eb3-42d2-92d0-d2737dd2bddb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:00.367855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (03c65f21-9eb3-42d2-92d0-d2737dd2bddb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:00.368187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Security group rule updated ['8847f164-307d-42d0-9040-ccfe75a13f21'] Oct 09 01:02:00.368577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Resource SecurityGroupRule deleted: 3ec583f6-b8e4-4269-b5a8-3cb7963ee25b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:00.369064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3ec583f6-b8e4-4269-b5a8-3cb7963ee25b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:00.369378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Security group rule updated ['8847f164-307d-42d0-9040-ccfe75a13f21'] Oct 09 01:02:00.369746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Resource SecurityGroupRule deleted: 9de8a4b9-819e-477d-9419-71820bf35d8c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:00.370102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9de8a4b9-819e-477d-9419-71820bf35d8c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:00.370421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Security group rule updated ['8847f164-307d-42d0-9040-ccfe75a13f21'] Oct 09 01:02:00.370783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Resource SecurityGroupRule deleted: d7fc850d-04c3-43a2-904f-5fb0709764b6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:00.371123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d7fc850d-04c3-43a2-904f-5fb0709764b6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:00.371435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8586866c-2dc3-4e74-9874-8db8eb822bcf admin admin] Security group rule updated ['8847f164-307d-42d0-9040-ccfe75a13f21'] Oct 09 01:02:00.822096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:423 started Oct 09 01:02:00.824842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efa4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=146000000,duration_sec=863,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:00.826338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:00.827105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:423 - starting polling. Elapsed:0.005 Oct 09 01:02:00.830117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:00.832330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port bf1ecde5-a035-439a-96b4-f7a4880b70e4 not present in bridge br-int Oct 09 01:02:00.832883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:02:00.833241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['bf1ecde5-a035-439a-96b4-f7a4880b70e4'] Oct 09 01:02:00.833645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port bf1ecde5-a035-439a-96b4-f7a4880b70e4 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:02:00.839984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363efa6,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:00.841716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363efa8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:00.842099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:423 - port information retrieved. Elapsed:0.020 Oct 09 01:02:00.842503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2', 'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'e465dbe5-5b91-47a1-b306-617be213fe16', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'a12e3d11-0a2d-4089-8565-84afac1050b3', '52c9f24a-41b9-4582-897b-a9388e078cc4'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:02:00.844128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:423 - agent port security group processed in 0.000 Oct 09 01:02:00.846419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:02:00.846913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'a12e3d11-0a2d-4089-8565-84afac1050b3', '52c9f24a-41b9-4582-897b-a9388e078cc4'} Oct 09 01:02:00.848009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 52c9f24a-41b9-4582-897b-a9388e078cc4 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:02:00.848625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:02:00.891959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bd67ba-9027-4989-a35d-afd698c720c0]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:02:00.892855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'a12e3d11-0a2d-4089-8565-84afac1050b3', '52c9f24a-41b9-4582-897b-a9388e078cc4'} removed Oct 09 01:02:00.963360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:02:00.964120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 4 from net-id = 93a9ba3d-37f0-48ce-9786-b421e5404102, seg-id = 691 Oct 09 01:02:00.975415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da1839,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:00.979554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363efaa,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4787}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:00.980065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:02:00.980536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:423 - treat_devices_removed completed in 0.134 Oct 09 01:02:00.980834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:423 - ports processed. Elapsed:0.159 Oct 09 01:02:00.981165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:423 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.159 Oct 09 01:02:01.465613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:01Z,description='Default security group',id=b5875bf1-e605-4302-8193-4956c4afe112,is_default=True,name='default',project_id='645b73a7f71d47c891fae7637fe36773',revision_number=1,rules=[SecurityGroupRule(106dc010-0564-41d2-9e5d-0de6918ceecf),SecurityGroupRule(2381b5b7-e2ce-40ca-a97b-9f476d0d49bd),SecurityGroupRule(4294e1a7-9447-4752-8c5b-a6878d964215),SecurityGroupRule(dfd8b93c-77bb-4bf3-badf-b40cc44df561)],shared=False,stateful=True,updated_at=2022-10-09T01:02:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:01.466175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (b5875bf1-e605-4302-8193-4956c4afe112), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:01.467046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:01Z,description=,direction='egress',ethertype='IPv4',id=106dc010-0564-41d2-9e5d-0de6918ceecf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='645b73a7f71d47c891fae7637fe36773',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b5875bf1-e605-4302-8193-4956c4afe112,updated_at=2022-10-09T01:02:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:01.467403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (106dc010-0564-41d2-9e5d-0de6918ceecf), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:01.467800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Security group rule updated ['b5875bf1-e605-4302-8193-4956c4afe112'] Oct 09 01:02:01.468630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:01Z,description=,direction='egress',ethertype='IPv6',id=2381b5b7-e2ce-40ca-a97b-9f476d0d49bd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='645b73a7f71d47c891fae7637fe36773',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b5875bf1-e605-4302-8193-4956c4afe112,updated_at=2022-10-09T01:02:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:01.469156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2381b5b7-e2ce-40ca-a97b-9f476d0d49bd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:01.469783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Security group rule updated ['b5875bf1-e605-4302-8193-4956c4afe112'] Oct 09 01:02:01.470484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:01Z,description=,direction='ingress',ethertype='IPv4',id=4294e1a7-9447-4752-8c5b-a6878d964215,normalized_cidr=None,port_range_max=,port_range_min=,project_id='645b73a7f71d47c891fae7637fe36773',protocol=,remote_address_group_id=,remote_group_id=b5875bf1-e605-4302-8193-4956c4afe112,remote_ip_prefix=,revision_number=0,security_group_id=b5875bf1-e605-4302-8193-4956c4afe112,updated_at=2022-10-09T01:02:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:01.470856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4294e1a7-9447-4752-8c5b-a6878d964215), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:01.471314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Security group rule updated ['b5875bf1-e605-4302-8193-4956c4afe112'] Oct 09 01:02:01.472115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:01Z,description=,direction='ingress',ethertype='IPv6',id=dfd8b93c-77bb-4bf3-badf-b40cc44df561,normalized_cidr=None,port_range_max=,port_range_min=,project_id='645b73a7f71d47c891fae7637fe36773',protocol=,remote_address_group_id=,remote_group_id=b5875bf1-e605-4302-8193-4956c4afe112,remote_ip_prefix=,revision_number=0,security_group_id=b5875bf1-e605-4302-8193-4956c4afe112,updated_at=2022-10-09T01:02:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:01.472939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (dfd8b93c-77bb-4bf3-badf-b40cc44df561), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:01.473382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Security group rule updated ['b5875bf1-e605-4302-8193-4956c4afe112'] Oct 09 01:02:01.605500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T01:02:01Z,description='',dns_domain=None,id=d72fe7df-301c-49a0-a853-9314a55d2b98,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-1846030340-network',project_id='645b73a7f71d47c891fae7637fe36773',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(d72fe7df-301c-49a0-a853-9314a55d2b98),segments=[NetworkSegment(c89e88c4-261a-43b4-9352-bffa16aedee1)],shared=False,status='ACTIVE',updated_at=2022-10-09T01:02:01Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:01.606007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (d72fe7df-301c-49a0-a853-9314a55d2b98), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-861a329f-836a-4520-a514-6832e975b4cc admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d72fe7df-301c-49a0-a853-9314a55d2b98 with segmentation id not found. Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 01:02:01.677193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 01:02:01.678463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 01:02:01.678463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 01:02:01.678463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 01:02:01.678463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d72fe7df-301c-49a0-a853-9314a55d2b98 with segmentation id not found. Oct 09 01:02:01.678463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 01:02:01.847350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9f1bca64-0df9-4766-b445-e661924b5adc admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ba7f1f5b-f2e6-44ec-8cbc-df1299c0582b)],cidr=172.20.0.0/28,created_at=2022-10-09T01:02:01Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=a6f1edf6-0fd3-4d7d-8435-8f9ac0d14d65,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-1846030340-subnet',network_id=d72fe7df-301c-49a0-a853-9314a55d2b98,project_id='645b73a7f71d47c891fae7637fe36773',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T01:02:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:01.848521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9f1bca64-0df9-4766-b445-e661924b5adc admin admin] Publish callbacks [] for Subnet (a6f1edf6-0fd3-4d7d-8435-8f9ac0d14d65), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.316960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroup deleted: 0ea9187f-2101-4156-8867-3f35f5d56794 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:02.317461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (0ea9187f-2101-4156-8867-3f35f5d56794), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.318002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0ea9187f-2101-4156-8867-3f35f5d56794',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:02.334070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0ea9187f-2101-4156-8867-3f35f5d56794',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:02.334831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 5febc4de-a5d3-450e-a79f-be5f7ef57b14 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:02.335207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5febc4de-a5d3-450e-a79f-be5f7ef57b14), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.335542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['0ea9187f-2101-4156-8867-3f35f5d56794'] Oct 09 01:02:02.335976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: fe5abf39-fe9f-4194-82a2-bcaf13449139 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:02.336324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fe5abf39-fe9f-4194-82a2-bcaf13449139), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.336824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['0ea9187f-2101-4156-8867-3f35f5d56794'] Oct 09 01:02:02.337364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: 10ea2549-d879-4797-8c45-dbf04cf1fdbf {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:02.337714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (10ea2549-d879-4797-8c45-dbf04cf1fdbf), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.338492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['0ea9187f-2101-4156-8867-3f35f5d56794'] Oct 09 01:02:02.339031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource SecurityGroupRule deleted: c8681dce-ecd5-4f9f-9f59-9f7b379e5092 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:02.339375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c8681dce-ecd5-4f9f-9f59-9f7b379e5092), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.339995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6a9feb2-cbd0-42ea-969b-2d46b12d173b tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Security group rule updated ['0ea9187f-2101-4156-8867-3f35f5d56794'] Oct 09 01:02:02.611634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:02Z,description='Default security group',id=7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3,is_default=True,name='default',project_id='77cd8ace7047445fb451ab960e27f19a',revision_number=1,rules=[SecurityGroupRule(3bf91b2f-cdcf-43ef-ac5a-9214b0ad0f71),SecurityGroupRule(43ab91c2-52cf-4c75-9435-c0e2fc5e1922),SecurityGroupRule(5c91a2a4-bd55-48a1-9137-8ee0c51ef78d),SecurityGroupRule(6fe8e7b3-d484-44e5-8d7b-be4788a5426d)],shared=False,stateful=True,updated_at=2022-10-09T01:02:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:02.612210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.613879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:02Z,description=,direction='egress',ethertype='IPv4',id=3bf91b2f-cdcf-43ef-ac5a-9214b0ad0f71,normalized_cidr=None,port_range_max=,port_range_min=,project_id='77cd8ace7047445fb451ab960e27f19a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3,updated_at=2022-10-09T01:02:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:02.614324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3bf91b2f-cdcf-43ef-ac5a-9214b0ad0f71), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.614855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Security group rule updated ['7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3'] Oct 09 01:02:02.615697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:02Z,description=,direction='egress',ethertype='IPv6',id=43ab91c2-52cf-4c75-9435-c0e2fc5e1922,normalized_cidr=None,port_range_max=,port_range_min=,project_id='77cd8ace7047445fb451ab960e27f19a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3,updated_at=2022-10-09T01:02:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:02.616142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (43ab91c2-52cf-4c75-9435-c0e2fc5e1922), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.616520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Security group rule updated ['7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3'] Oct 09 01:02:02.617410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:02Z,description=,direction='ingress',ethertype='IPv4',id=5c91a2a4-bd55-48a1-9137-8ee0c51ef78d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='77cd8ace7047445fb451ab960e27f19a',protocol=,remote_address_group_id=,remote_group_id=7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3,remote_ip_prefix=,revision_number=0,security_group_id=7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3,updated_at=2022-10-09T01:02:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:02.617826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5c91a2a4-bd55-48a1-9137-8ee0c51ef78d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.618220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Security group rule updated ['7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3'] Oct 09 01:02:02.618950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:02Z,description=,direction='ingress',ethertype='IPv6',id=6fe8e7b3-d484-44e5-8d7b-be4788a5426d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='77cd8ace7047445fb451ab960e27f19a',protocol=,remote_address_group_id=,remote_group_id=7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3,remote_ip_prefix=,revision_number=0,security_group_id=7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3,updated_at=2022-10-09T01:02:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:02.619545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6fe8e7b3-d484-44e5-8d7b-be4788a5426d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.619961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Security group rule updated ['7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3'] Oct 09 01:02:02.803365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T01:02:02Z,description='',dns_domain=None,id=9860f881-ac0a-467a-aaff-4717f04fd23a,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-623782020-network',project_id='77cd8ace7047445fb451ab960e27f19a',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(9860f881-ac0a-467a-aaff-4717f04fd23a),segments=[NetworkSegment(0ad33c35-1ad3-464f-84d4-267c1d2d84f0)],shared=False,status='ACTIVE',updated_at=2022-10-09T01:02:02Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:02.804615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (9860f881-ac0a-467a-aaff-4717f04fd23a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:02.822612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:424 started Oct 09 01:02:02.825148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=146000000,duration_sec=865,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:02.825735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:02.826095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:424 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-5d17b441-dc67-4b7b-a8c7-778d9eb0897a admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 9860f881-ac0a-467a-aaff-4717f04fd23a with segmentation id not found. Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 01:02:02.885489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 01:02:02.886966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 01:02:02.886966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 01:02:02.886966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 01:02:02.886966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 9860f881-ac0a-467a-aaff-4717f04fd23a with segmentation id not found. Oct 09 01:02:02.886966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 01:02:02.943067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a80b00e1-8cc7-4ce5-bca8-9a6f36b43136 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Resource Port deleted: ae310aaf-3088-4039-aa5d-01e69bb90c0b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:02.943517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a80b00e1-8cc7-4ce5-bca8-9a6f36b43136 tempest-AttachVolumeNegativeTest-1432185703 tempest-AttachVolumeNegativeTest-1432185703-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (ae310aaf-3088-4039-aa5d-01e69bb90c0b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:03.072705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-38d51f72-2a23-465b-9ad5-d2968a8bb42b admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(b733dcc8-d035-4dc6-b042-fe6153d0e5ea)],cidr=172.20.0.0/28,created_at=2022-10-09T01:02:02Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=da8c9eff-9f05-456a-bb53-c9dab0c90b1c,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-623782020-subnet',network_id=9860f881-ac0a-467a-aaff-4717f04fd23a,project_id='77cd8ace7047445fb451ab960e27f19a',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T01:02:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:03.073370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-38d51f72-2a23-465b-9ad5-d2968a8bb42b admin admin] Publish callbacks [] for Subnet (da8c9eff-9f05-456a-bb53-c9dab0c90b1c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:03.465621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-07500209-50b5-43ac-b6cb-983478f5cf59 admin admin] Resource Subnet deleted: a6f1edf6-0fd3-4d7d-8435-8f9ac0d14d65 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:03.466260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-07500209-50b5-43ac-b6cb-983478f5cf59 admin admin] Publish callbacks [] for Subnet (a6f1edf6-0fd3-4d7d-8435-8f9ac0d14d65), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:03.772113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6ed3fd79-b3a4-4bdf-a61e-3ccafd116862 admin admin] Resource Network deleted: d72fe7df-301c-49a0-a853-9314a55d2b98 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:03.772486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6ed3fd79-b3a4-4bdf-a61e-3ccafd116862 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (d72fe7df-301c-49a0-a853-9314a55d2b98), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:03.975779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04feda5f-97b2-4837-b939-f8fa9d7a0f81 admin admin] Resource Subnet deleted: da8c9eff-9f05-456a-bb53-c9dab0c90b1c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:03.976336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04feda5f-97b2-4837-b939-f8fa9d7a0f81 admin admin] Publish callbacks [] for Subnet (da8c9eff-9f05-456a-bb53-c9dab0c90b1c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:04.293545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-86b73d5b-a1ba-4d5c-8f8b-bee6d9b9790c admin admin] Resource Network deleted: 9860f881-ac0a-467a-aaff-4717f04fd23a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:04.294142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-86b73d5b-a1ba-4d5c-8f8b-bee6d9b9790c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (9860f881-ac0a-467a-aaff-4717f04fd23a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:04.622649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Resource SecurityGroup deleted: b5875bf1-e605-4302-8193-4956c4afe112 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:04.623189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (b5875bf1-e605-4302-8193-4956c4afe112), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:04.623773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b5875bf1-e605-4302-8193-4956c4afe112',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:04.638924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b5875bf1-e605-4302-8193-4956c4afe112',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:04.639571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Resource SecurityGroupRule deleted: 106dc010-0564-41d2-9e5d-0de6918ceecf {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:04.640063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (106dc010-0564-41d2-9e5d-0de6918ceecf), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:04.640487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Security group rule updated ['b5875bf1-e605-4302-8193-4956c4afe112'] Oct 09 01:02:04.641113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Resource SecurityGroupRule deleted: 2381b5b7-e2ce-40ca-a97b-9f476d0d49bd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:04.641497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2381b5b7-e2ce-40ca-a97b-9f476d0d49bd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:04.641920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Security group rule updated ['b5875bf1-e605-4302-8193-4956c4afe112'] Oct 09 01:02:04.642295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Resource SecurityGroupRule deleted: 4294e1a7-9447-4752-8c5b-a6878d964215 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:04.642683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4294e1a7-9447-4752-8c5b-a6878d964215), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:04.643117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Security group rule updated ['b5875bf1-e605-4302-8193-4956c4afe112'] Oct 09 01:02:04.643853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Resource SecurityGroupRule deleted: dfd8b93c-77bb-4bf3-badf-b40cc44df561 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:04.644560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (dfd8b93c-77bb-4bf3-badf-b40cc44df561), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:04.644978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-619790ab-d6fb-4eb8-9931-d889d502c0cf admin admin] Security group rule updated ['b5875bf1-e605-4302-8193-4956c4afe112'] Oct 09 01:02:04.824070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:425 started Oct 09 01:02:04.826435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=147000000,duration_sec=867,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:04.827041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:04.827377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:425 - starting polling. Elapsed:0.004 Oct 09 01:02:04.829721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:04.831282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port ae310aaf-3088-4039-aa5d-01e69bb90c0b not present in bridge br-int Oct 09 01:02:04.831633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:02:04.831923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['ae310aaf-3088-4039-aa5d-01e69bb90c0b'] Oct 09 01:02:04.832241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port ae310aaf-3088-4039-aa5d-01e69bb90c0b is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:02:04.835164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:425 - port information retrieved. Elapsed:0.011 Oct 09 01:02:04.835496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:425 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 09 01:02:05.101092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Resource SecurityGroup deleted: 7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:05.101689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:05.102076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:05.115576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:05.116144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Resource SecurityGroupRule deleted: 3bf91b2f-cdcf-43ef-ac5a-9214b0ad0f71 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:05.116576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3bf91b2f-cdcf-43ef-ac5a-9214b0ad0f71), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:05.116972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Security group rule updated ['7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3'] Oct 09 01:02:05.117422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Resource SecurityGroupRule deleted: 43ab91c2-52cf-4c75-9435-c0e2fc5e1922 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:05.117828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (43ab91c2-52cf-4c75-9435-c0e2fc5e1922), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:05.118323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Security group rule updated ['7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3'] Oct 09 01:02:05.118888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Resource SecurityGroupRule deleted: 5c91a2a4-bd55-48a1-9137-8ee0c51ef78d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:05.119290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5c91a2a4-bd55-48a1-9137-8ee0c51ef78d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:05.119728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Security group rule updated ['7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3'] Oct 09 01:02:05.120152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Resource SecurityGroupRule deleted: 6fe8e7b3-d484-44e5-8d7b-be4788a5426d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:05.120573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6fe8e7b3-d484-44e5-8d7b-be4788a5426d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:05.120974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-51572166-f0db-4ef7-802f-7b2cbbd5df40 admin admin] Security group rule updated ['7c7864ab-a6c4-4fc0-9dd2-5c66daa340b3'] Oct 09 01:02:06.825406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:426 started Oct 09 01:02:06.828185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=149000000,duration_sec=869,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:06.828773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:06.829147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:426 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:07.712607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dcd75777-bcfd-43c8-a9e2-61aef90631ef admin admin] Resource Port deleted: e465dbe5-5b91-47a1-b306-617be213fe16 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:07.712607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dcd75777-bcfd-43c8-a9e2-61aef90631ef admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (e465dbe5-5b91-47a1-b306-617be213fe16), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:08.825949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:427 started Oct 09 01:02:08.828565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=149000000,duration_sec=871,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:08.829228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:08.829661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:427 - starting polling. Elapsed:0.004 Oct 09 01:02:08.832801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:08.836026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e465dbe5-5b, col_values=(('tag', 4095),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:02:08.842854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363efb4,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:08.843239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['e465dbe5-5b91-47a1-b306-617be213fe16'] Oct 09 01:02:08.843858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:02:08.892658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d231124-92e4-4324-bb4f-140428eb9e7e]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:02:08.897956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:427 - port information retrieved. Elapsed:0.072 Oct 09 01:02:08.898401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:427 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.073 Oct 09 01:02:09.002242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-095920cd-2497-463b-aa28-ff42ee635295 admin admin] Resource Port deleted: b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:09.003264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-095920cd-2497-463b-aa28-ff42ee635295 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.053351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e2ed203d-6bbf-4553-8477-7329b925cc99","delete","qr-e465dbe5-5b",15,["map",[["attached-mac","fa:16:3e:d5:7e:14"],["iface-id","e465dbe5-5b91-47a1-b306-617be213fe16"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:02:09.466876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["26c2998e-8dce-482f-be10-aa8c60ea3cb6","delete","qg-b33db3c4-e8",16,["map",[["attached-mac","fa:16:3e:fd:41:e9"],["iface-id","b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:02:09.475553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c292a136-67c6-49e9-b408-899c40f68ce2 admin admin] Resource Subnet deleted: ff98a4f2-ed81-452c-99a3-cf1c43a2d01b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:09.475979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c292a136-67c6-49e9-b408-899c40f68ce2 admin admin] Publish callbacks [] for Subnet (ff98a4f2-ed81-452c-99a3-cf1c43a2d01b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.630832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5ddea7bd-dac5-47d0-bd9a-2a60e35d9a26","delete","tap8a28fe29-98",10,["map",[["attached-mac","fa:16:3e:ea:52:b9"],["iface-id","8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:02:09.801698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:09Z,description='Default security group',id=4a62e3d3-f610-4dc9-b072-a66996a7ecaa,is_default=True,name='default',project_id='53bd93d63bc743f881bae696798e2a0b',revision_number=1,rules=[SecurityGroupRule(5432e26f-1e70-4263-a8fa-5e46a9ad54b6),SecurityGroupRule(69d4f391-de11-4c16-bc48-e48db0716020),SecurityGroupRule(ba9882cd-dea8-48e6-8fb6-74bfef415fe4),SecurityGroupRule(e798cb68-d006-44b7-bfcb-f362de5950a3)],shared=False,stateful=True,updated_at=2022-10-09T01:02:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:09.802074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (4a62e3d3-f610-4dc9-b072-a66996a7ecaa), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.802884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:09Z,description=,direction='ingress',ethertype='IPv4',id=5432e26f-1e70-4263-a8fa-5e46a9ad54b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53bd93d63bc743f881bae696798e2a0b',protocol=,remote_address_group_id=,remote_group_id=4a62e3d3-f610-4dc9-b072-a66996a7ecaa,remote_ip_prefix=,revision_number=0,security_group_id=4a62e3d3-f610-4dc9-b072-a66996a7ecaa,updated_at=2022-10-09T01:02:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:09.803458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5432e26f-1e70-4263-a8fa-5e46a9ad54b6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.803795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Security group rule updated ['4a62e3d3-f610-4dc9-b072-a66996a7ecaa'] Oct 09 01:02:09.804478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:09Z,description=,direction='ingress',ethertype='IPv6',id=69d4f391-de11-4c16-bc48-e48db0716020,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53bd93d63bc743f881bae696798e2a0b',protocol=,remote_address_group_id=,remote_group_id=4a62e3d3-f610-4dc9-b072-a66996a7ecaa,remote_ip_prefix=,revision_number=0,security_group_id=4a62e3d3-f610-4dc9-b072-a66996a7ecaa,updated_at=2022-10-09T01:02:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:09.804820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (69d4f391-de11-4c16-bc48-e48db0716020), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.805145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Security group rule updated ['4a62e3d3-f610-4dc9-b072-a66996a7ecaa'] Oct 09 01:02:09.806245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:09Z,description=,direction='egress',ethertype='IPv6',id=ba9882cd-dea8-48e6-8fb6-74bfef415fe4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53bd93d63bc743f881bae696798e2a0b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a62e3d3-f610-4dc9-b072-a66996a7ecaa,updated_at=2022-10-09T01:02:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:09.806245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ba9882cd-dea8-48e6-8fb6-74bfef415fe4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.806468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Security group rule updated ['4a62e3d3-f610-4dc9-b072-a66996a7ecaa'] Oct 09 01:02:09.807064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:09Z,description=,direction='egress',ethertype='IPv4',id=e798cb68-d006-44b7-bfcb-f362de5950a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53bd93d63bc743f881bae696798e2a0b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a62e3d3-f610-4dc9-b072-a66996a7ecaa,updated_at=2022-10-09T01:02:09Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:09.807406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e798cb68-d006-44b7-bfcb-f362de5950a3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.807754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce6a19d4-dfbd-4b5b-bb6c-833fc9070b62 admin admin] Security group rule updated ['4a62e3d3-f610-4dc9-b072-a66996a7ecaa'] Oct 09 01:02:09.842990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5febf7a5-04ec-4663-ac98-6982b1527e8a admin admin] Resource Port deleted: 8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:09.844191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5febf7a5-04ec-4663-ac98-6982b1527e8a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.976278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Resource SecurityGroup deleted: 4a62e3d3-f610-4dc9-b072-a66996a7ecaa {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:09.976764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (4a62e3d3-f610-4dc9-b072-a66996a7ecaa), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.978085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4a62e3d3-f610-4dc9-b072-a66996a7ecaa',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:09.992045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4a62e3d3-f610-4dc9-b072-a66996a7ecaa',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:09.992566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Resource SecurityGroupRule deleted: 5432e26f-1e70-4263-a8fa-5e46a9ad54b6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:09.992938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5432e26f-1e70-4263-a8fa-5e46a9ad54b6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.993273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Security group rule updated ['4a62e3d3-f610-4dc9-b072-a66996a7ecaa'] Oct 09 01:02:09.993711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Resource SecurityGroupRule deleted: 69d4f391-de11-4c16-bc48-e48db0716020 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:09.994059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (69d4f391-de11-4c16-bc48-e48db0716020), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.994375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Security group rule updated ['4a62e3d3-f610-4dc9-b072-a66996a7ecaa'] Oct 09 01:02:09.994735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Resource SecurityGroupRule deleted: ba9882cd-dea8-48e6-8fb6-74bfef415fe4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:09.995256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ba9882cd-dea8-48e6-8fb6-74bfef415fe4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.995787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Security group rule updated ['4a62e3d3-f610-4dc9-b072-a66996a7ecaa'] Oct 09 01:02:09.996150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Resource SecurityGroupRule deleted: e798cb68-d006-44b7-bfcb-f362de5950a3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:09.996633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e798cb68-d006-44b7-bfcb-f362de5950a3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:09.997144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5196787a-c592-4150-bf5c-f287975f55a6 admin admin] Security group rule updated ['4a62e3d3-f610-4dc9-b072-a66996a7ecaa'] Oct 09 01:02:10.130669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5febf7a5-04ec-4663-ac98-6982b1527e8a admin admin] Resource Network deleted: ef6b019b-3ff0-42c3-b2bd-354f2c856ccc {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.131046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5febf7a5-04ec-4663-ac98-6982b1527e8a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (ef6b019b-3ff0-42c3-b2bd-354f2c856ccc), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.476039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:10Z,description='Default security group',id=73a14ca0-b28d-4862-b05b-b8d5004a644b,is_default=True,name='default',project_id='d7ab625af44d4b25894a9bffbbddfa4c',revision_number=1,rules=[SecurityGroupRule(1394e905-6f54-466b-8b2b-9676871a5043),SecurityGroupRule(4808d1f7-444a-45e1-9857-e5a04060e99d),SecurityGroupRule(a684a54d-d159-4306-8dab-46a345d02f2d),SecurityGroupRule(ebf28509-1d5b-48bd-8037-3f15eda2d044)],shared=False,stateful=True,updated_at=2022-10-09T01:02:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:10.476422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (73a14ca0-b28d-4862-b05b-b8d5004a644b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.477055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:10Z,description=,direction='ingress',ethertype='IPv6',id=1394e905-6f54-466b-8b2b-9676871a5043,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7ab625af44d4b25894a9bffbbddfa4c',protocol=,remote_address_group_id=,remote_group_id=73a14ca0-b28d-4862-b05b-b8d5004a644b,remote_ip_prefix=,revision_number=0,security_group_id=73a14ca0-b28d-4862-b05b-b8d5004a644b,updated_at=2022-10-09T01:02:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:10.477406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1394e905-6f54-466b-8b2b-9676871a5043), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.477747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Security group rule updated ['73a14ca0-b28d-4862-b05b-b8d5004a644b'] Oct 09 01:02:10.478423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:10Z,description=,direction='ingress',ethertype='IPv4',id=4808d1f7-444a-45e1-9857-e5a04060e99d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7ab625af44d4b25894a9bffbbddfa4c',protocol=,remote_address_group_id=,remote_group_id=73a14ca0-b28d-4862-b05b-b8d5004a644b,remote_ip_prefix=,revision_number=0,security_group_id=73a14ca0-b28d-4862-b05b-b8d5004a644b,updated_at=2022-10-09T01:02:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:10.478782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4808d1f7-444a-45e1-9857-e5a04060e99d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.479107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Security group rule updated ['73a14ca0-b28d-4862-b05b-b8d5004a644b'] Oct 09 01:02:10.479790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:10Z,description=,direction='egress',ethertype='IPv6',id=a684a54d-d159-4306-8dab-46a345d02f2d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7ab625af44d4b25894a9bffbbddfa4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=73a14ca0-b28d-4862-b05b-b8d5004a644b,updated_at=2022-10-09T01:02:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:10.480142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a684a54d-d159-4306-8dab-46a345d02f2d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.480470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Security group rule updated ['73a14ca0-b28d-4862-b05b-b8d5004a644b'] Oct 09 01:02:10.481162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:10Z,description=,direction='egress',ethertype='IPv4',id=ebf28509-1d5b-48bd-8037-3f15eda2d044,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7ab625af44d4b25894a9bffbbddfa4c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=73a14ca0-b28d-4862-b05b-b8d5004a644b,updated_at=2022-10-09T01:02:10Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:10.481490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ebf28509-1d5b-48bd-8037-3f15eda2d044), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.481816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eb82e2d5-448c-4f33-98f3-9033c63c763c admin admin] Security group rule updated ['73a14ca0-b28d-4862-b05b-b8d5004a644b'] Oct 09 01:02:10.536886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Resource SecurityGroup deleted: d1f916c0-5e4a-464a-a471-e22192e192fb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.537458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (d1f916c0-5e4a-464a-a471-e22192e192fb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.538132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d1f916c0-5e4a-464a-a471-e22192e192fb',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:10.552113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d1f916c0-5e4a-464a-a471-e22192e192fb',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:10.552804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Resource SecurityGroupRule deleted: 15378fd2-c89f-4a7a-9b4d-6a898fe0337e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.553475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (15378fd2-c89f-4a7a-9b4d-6a898fe0337e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.553813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Security group rule updated ['d1f916c0-5e4a-464a-a471-e22192e192fb'] Oct 09 01:02:10.554194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Resource SecurityGroupRule deleted: 862c7403-06b4-4f32-8b59-b836d3ace96e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.554727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (862c7403-06b4-4f32-8b59-b836d3ace96e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.555658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Security group rule updated ['d1f916c0-5e4a-464a-a471-e22192e192fb'] Oct 09 01:02:10.555959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Resource SecurityGroupRule deleted: b0e94df0-4fa2-4bfc-9ce8-e93313a7c738 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.556542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b0e94df0-4fa2-4bfc-9ce8-e93313a7c738), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.557086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Security group rule updated ['d1f916c0-5e4a-464a-a471-e22192e192fb'] Oct 09 01:02:10.557423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Resource SecurityGroupRule deleted: b405d028-6736-45c6-af64-55973cd5942e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.557893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b405d028-6736-45c6-af64-55973cd5942e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.558206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5e475de8-4633-4dd2-bcb0-2cab45b869a1 admin admin] Security group rule updated ['d1f916c0-5e4a-464a-a471-e22192e192fb'] Oct 09 01:02:10.618512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Resource SecurityGroup deleted: 73a14ca0-b28d-4862-b05b-b8d5004a644b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.619400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (73a14ca0-b28d-4862-b05b-b8d5004a644b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.621406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('73a14ca0-b28d-4862-b05b-b8d5004a644b',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:10.636669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('73a14ca0-b28d-4862-b05b-b8d5004a644b',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:10.637259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Resource SecurityGroupRule deleted: 1394e905-6f54-466b-8b2b-9676871a5043 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.637635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1394e905-6f54-466b-8b2b-9676871a5043), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.637975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Security group rule updated ['73a14ca0-b28d-4862-b05b-b8d5004a644b'] Oct 09 01:02:10.638364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Resource SecurityGroupRule deleted: 4808d1f7-444a-45e1-9857-e5a04060e99d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.639021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4808d1f7-444a-45e1-9857-e5a04060e99d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.639504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Security group rule updated ['73a14ca0-b28d-4862-b05b-b8d5004a644b'] Oct 09 01:02:10.639997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Resource SecurityGroupRule deleted: a684a54d-d159-4306-8dab-46a345d02f2d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.640353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a684a54d-d159-4306-8dab-46a345d02f2d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.640670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Security group rule updated ['73a14ca0-b28d-4862-b05b-b8d5004a644b'] Oct 09 01:02:10.641299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Resource SecurityGroupRule deleted: ebf28509-1d5b-48bd-8037-3f15eda2d044 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:10.641792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ebf28509-1d5b-48bd-8037-3f15eda2d044), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.642122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-951f9ac8-5815-499f-b8d5-04243c8a8cc1 admin admin] Security group rule updated ['73a14ca0-b28d-4862-b05b-b8d5004a644b'] Oct 09 01:02:10.826921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:428 started Oct 09 01:02:10.830291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=151000000,duration_sec=873,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:10.830972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:10.831457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:428 - starting polling. Elapsed:0.005 Oct 09 01:02:10.833707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:10.838713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363efb8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:10.841074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363efba,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:10.843252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363efbc,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:10.844340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:428 - port information retrieved. Elapsed:0.018 Oct 09 01:02:10.844745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'e465dbe5-5b91-47a1-b306-617be213fe16', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:02:10.845000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:428 - agent port security group processed in 0.000 Oct 09 01:02:10.846920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:02:10.847436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'e465dbe5-5b91-47a1-b306-617be213fe16', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2'} Oct 09 01:02:10.847787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e465dbe5-5b91-47a1-b306-617be213fe16 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:02:10.848260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 8 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:02:10.896178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f9099-1156-4198-95c9-7989f8fa6459]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:02:10.896875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'e465dbe5-5b91-47a1-b306-617be213fe16', '8a28fe29-98d4-4ca2-9d2f-f66e990bc6b1', 'b33db3c4-e8e3-4b50-8a3e-2692ee1a44e2'} removed Oct 09 01:02:10.976942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:02:10.977316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:02:10.977690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 6 from net-id = ef6b019b-3ff0-42c3-b2bd-354f2c856ccc, seg-id = 689 Oct 09 01:02:10.981683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da183b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:10.983642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363efbe,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4785}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:10.984102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:428 - treat_devices_removed completed in 0.137 Oct 09 01:02:10.984442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:428 - ports processed. Elapsed:0.158 Oct 09 01:02:10.984797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:428 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.158 Oct 09 01:02:12.827922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:429 started Oct 09 01:02:12.830261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=151000000,duration_sec=875,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:12.830830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:12.831184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:429 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:02:14.600677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:14Z,description='Default security group',id=02d9bc5d-895b-4088-a256-720b06a94678,is_default=True,name='default',project_id='97b9086fac714440938c6c50bd5026c3',revision_number=1,rules=[SecurityGroupRule(09d78557-2341-49d6-84a6-03b334e4610f),SecurityGroupRule(2d0488cf-c8f4-4cce-9cb5-34401e77e2e6),SecurityGroupRule(73f703bd-ca56-425c-8004-407067a104d0),SecurityGroupRule(c0a96355-902d-41b0-9c23-9788b0b527db)],shared=False,stateful=True,updated_at=2022-10-09T01:02:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:14.601294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (02d9bc5d-895b-4088-a256-720b06a94678), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.601688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:14Z,description=,direction='ingress',ethertype='IPv6',id=09d78557-2341-49d6-84a6-03b334e4610f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='97b9086fac714440938c6c50bd5026c3',protocol=,remote_address_group_id=,remote_group_id=02d9bc5d-895b-4088-a256-720b06a94678,remote_ip_prefix=,revision_number=0,security_group_id=02d9bc5d-895b-4088-a256-720b06a94678,updated_at=2022-10-09T01:02:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:14.602045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (09d78557-2341-49d6-84a6-03b334e4610f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.602377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Security group rule updated ['02d9bc5d-895b-4088-a256-720b06a94678'] Oct 09 01:02:14.603032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:14Z,description=,direction='egress',ethertype='IPv6',id=2d0488cf-c8f4-4cce-9cb5-34401e77e2e6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='97b9086fac714440938c6c50bd5026c3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=02d9bc5d-895b-4088-a256-720b06a94678,updated_at=2022-10-09T01:02:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:14.603374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2d0488cf-c8f4-4cce-9cb5-34401e77e2e6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.603715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Security group rule updated ['02d9bc5d-895b-4088-a256-720b06a94678'] Oct 09 01:02:14.604418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:14Z,description=,direction='ingress',ethertype='IPv4',id=73f703bd-ca56-425c-8004-407067a104d0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='97b9086fac714440938c6c50bd5026c3',protocol=,remote_address_group_id=,remote_group_id=02d9bc5d-895b-4088-a256-720b06a94678,remote_ip_prefix=,revision_number=0,security_group_id=02d9bc5d-895b-4088-a256-720b06a94678,updated_at=2022-10-09T01:02:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:14.604755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (73f703bd-ca56-425c-8004-407067a104d0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.605070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Security group rule updated ['02d9bc5d-895b-4088-a256-720b06a94678'] Oct 09 01:02:14.605899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:14Z,description=,direction='egress',ethertype='IPv4',id=c0a96355-902d-41b0-9c23-9788b0b527db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='97b9086fac714440938c6c50bd5026c3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=02d9bc5d-895b-4088-a256-720b06a94678,updated_at=2022-10-09T01:02:14Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:14.606240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c0a96355-902d-41b0-9c23-9788b0b527db), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.606557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b2fb20f-198d-4ca0-9802-f27ebf455c03 admin admin] Security group rule updated ['02d9bc5d-895b-4088-a256-720b06a94678'] Oct 09 01:02:14.715253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Resource SecurityGroup deleted: 02d9bc5d-895b-4088-a256-720b06a94678 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:14.715754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (02d9bc5d-895b-4088-a256-720b06a94678), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.716349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('02d9bc5d-895b-4088-a256-720b06a94678',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:14.730123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('02d9bc5d-895b-4088-a256-720b06a94678',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:14.730663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Resource SecurityGroupRule deleted: 09d78557-2341-49d6-84a6-03b334e4610f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:14.731095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (09d78557-2341-49d6-84a6-03b334e4610f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.731524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Security group rule updated ['02d9bc5d-895b-4088-a256-720b06a94678'] Oct 09 01:02:14.731998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Resource SecurityGroupRule deleted: 2d0488cf-c8f4-4cce-9cb5-34401e77e2e6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:14.732434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2d0488cf-c8f4-4cce-9cb5-34401e77e2e6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.732811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Security group rule updated ['02d9bc5d-895b-4088-a256-720b06a94678'] Oct 09 01:02:14.733347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Resource SecurityGroupRule deleted: 73f703bd-ca56-425c-8004-407067a104d0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:14.733687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (73f703bd-ca56-425c-8004-407067a104d0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.734004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Security group rule updated ['02d9bc5d-895b-4088-a256-720b06a94678'] Oct 09 01:02:14.734370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Resource SecurityGroupRule deleted: c0a96355-902d-41b0-9c23-9788b0b527db {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:14.734706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c0a96355-902d-41b0-9c23-9788b0b527db), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:14.735037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b3a49051-6684-4af7-9fb4-db345d228d04 admin admin] Security group rule updated ['02d9bc5d-895b-4088-a256-720b06a94678'] Oct 09 01:02:14.828634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:430 started Oct 09 01:02:14.831099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=152000000,duration_sec=877,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:14.832304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:14.832665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:430 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:15.964056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:15Z,description='Default security group',id=12f434ae-3c3c-475c-a5a8-a44284d2fcf7,is_default=True,name='default',project_id='d9b18dc3d0f14cb982a654cba1c40532',revision_number=1,rules=[SecurityGroupRule(36fdbcdf-81ef-4f07-a157-cb2dd44fb483),SecurityGroupRule(a881624a-e0b9-4cd2-bba0-6816fa609252),SecurityGroupRule(c0be0a5b-8422-445a-ab1d-e6290fc9cb19),SecurityGroupRule(c7d1df7e-c235-4375-8002-7bac715e8507)],shared=False,stateful=True,updated_at=2022-10-09T01:02:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:15.964697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (12f434ae-3c3c-475c-a5a8-a44284d2fcf7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:15.965157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:15Z,description=,direction='ingress',ethertype='IPv6',id=36fdbcdf-81ef-4f07-a157-cb2dd44fb483,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d9b18dc3d0f14cb982a654cba1c40532',protocol=,remote_address_group_id=,remote_group_id=12f434ae-3c3c-475c-a5a8-a44284d2fcf7,remote_ip_prefix=,revision_number=0,security_group_id=12f434ae-3c3c-475c-a5a8-a44284d2fcf7,updated_at=2022-10-09T01:02:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:15.965519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (36fdbcdf-81ef-4f07-a157-cb2dd44fb483), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:15.965857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Security group rule updated ['12f434ae-3c3c-475c-a5a8-a44284d2fcf7'] Oct 09 01:02:15.966726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:15Z,description=,direction='egress',ethertype='IPv4',id=a881624a-e0b9-4cd2-bba0-6816fa609252,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d9b18dc3d0f14cb982a654cba1c40532',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=12f434ae-3c3c-475c-a5a8-a44284d2fcf7,updated_at=2022-10-09T01:02:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:15.967086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (a881624a-e0b9-4cd2-bba0-6816fa609252), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:15.968226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Security group rule updated ['12f434ae-3c3c-475c-a5a8-a44284d2fcf7'] Oct 09 01:02:15.968914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:15Z,description=,direction='egress',ethertype='IPv6',id=c0be0a5b-8422-445a-ab1d-e6290fc9cb19,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d9b18dc3d0f14cb982a654cba1c40532',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=12f434ae-3c3c-475c-a5a8-a44284d2fcf7,updated_at=2022-10-09T01:02:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:15.969302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c0be0a5b-8422-445a-ab1d-e6290fc9cb19), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:15.969624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Security group rule updated ['12f434ae-3c3c-475c-a5a8-a44284d2fcf7'] Oct 09 01:02:15.970297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:15Z,description=,direction='ingress',ethertype='IPv4',id=c7d1df7e-c235-4375-8002-7bac715e8507,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d9b18dc3d0f14cb982a654cba1c40532',protocol=,remote_address_group_id=,remote_group_id=12f434ae-3c3c-475c-a5a8-a44284d2fcf7,remote_ip_prefix=,revision_number=0,security_group_id=12f434ae-3c3c-475c-a5a8-a44284d2fcf7,updated_at=2022-10-09T01:02:15Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:15.970649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c7d1df7e-c235-4375-8002-7bac715e8507), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:15.970977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b37f9b27-b477-4ed1-9f56-9094d106e18e admin admin] Security group rule updated ['12f434ae-3c3c-475c-a5a8-a44284d2fcf7'] Oct 09 01:02:16.142313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Resource SecurityGroup deleted: 12f434ae-3c3c-475c-a5a8-a44284d2fcf7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.142767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (12f434ae-3c3c-475c-a5a8-a44284d2fcf7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.143328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('12f434ae-3c3c-475c-a5a8-a44284d2fcf7',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:16.159274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('12f434ae-3c3c-475c-a5a8-a44284d2fcf7',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:16.160673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Resource SecurityGroupRule deleted: 36fdbcdf-81ef-4f07-a157-cb2dd44fb483 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.160981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (36fdbcdf-81ef-4f07-a157-cb2dd44fb483), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.161308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Security group rule updated ['12f434ae-3c3c-475c-a5a8-a44284d2fcf7'] Oct 09 01:02:16.161694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Resource SecurityGroupRule deleted: a881624a-e0b9-4cd2-bba0-6816fa609252 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.162045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a881624a-e0b9-4cd2-bba0-6816fa609252), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.162386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Security group rule updated ['12f434ae-3c3c-475c-a5a8-a44284d2fcf7'] Oct 09 01:02:16.162754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Resource SecurityGroupRule deleted: c0be0a5b-8422-445a-ab1d-e6290fc9cb19 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.163093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c0be0a5b-8422-445a-ab1d-e6290fc9cb19), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.163514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Security group rule updated ['12f434ae-3c3c-475c-a5a8-a44284d2fcf7'] Oct 09 01:02:16.164076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Resource SecurityGroupRule deleted: c7d1df7e-c235-4375-8002-7bac715e8507 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.164472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c7d1df7e-c235-4375-8002-7bac715e8507), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.164943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-185cb823-b605-4d3e-9adf-b9c448fa8c64 admin admin] Security group rule updated ['12f434ae-3c3c-475c-a5a8-a44284d2fcf7'] Oct 09 01:02:16.222515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:16Z,description='Default security group',id=f200aa37-bea6-4cb6-9ecd-ae113e3bc548,is_default=True,name='default',project_id='5562380a08c440759380988a5b2d0b7c',revision_number=1,rules=[SecurityGroupRule(337e2915-d20b-4c45-a889-794de72a360e),SecurityGroupRule(4bfe7bdc-dc28-4cb3-909e-26bd297a0de3),SecurityGroupRule(67b08924-e512-4c28-a9f7-49a65a78acbe),SecurityGroupRule(7f177b47-a26a-4cb3-9117-f12134355152)],shared=False,stateful=True,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.222979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (f200aa37-bea6-4cb6-9ecd-ae113e3bc548), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.223708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:16Z,description=,direction='egress',ethertype='IPv4',id=337e2915-d20b-4c45-a889-794de72a360e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5562380a08c440759380988a5b2d0b7c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f200aa37-bea6-4cb6-9ecd-ae113e3bc548,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.224136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (337e2915-d20b-4c45-a889-794de72a360e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.224557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Security group rule updated ['f200aa37-bea6-4cb6-9ecd-ae113e3bc548'] Oct 09 01:02:16.225303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:16Z,description=,direction='ingress',ethertype='IPv4',id=4bfe7bdc-dc28-4cb3-909e-26bd297a0de3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5562380a08c440759380988a5b2d0b7c',protocol=,remote_address_group_id=,remote_group_id=f200aa37-bea6-4cb6-9ecd-ae113e3bc548,remote_ip_prefix=,revision_number=0,security_group_id=f200aa37-bea6-4cb6-9ecd-ae113e3bc548,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.225732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4bfe7bdc-dc28-4cb3-909e-26bd297a0de3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.226058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Security group rule updated ['f200aa37-bea6-4cb6-9ecd-ae113e3bc548'] Oct 09 01:02:16.226781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:16Z,description=,direction='egress',ethertype='IPv6',id=67b08924-e512-4c28-a9f7-49a65a78acbe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5562380a08c440759380988a5b2d0b7c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f200aa37-bea6-4cb6-9ecd-ae113e3bc548,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.227128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (67b08924-e512-4c28-a9f7-49a65a78acbe), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.227460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Security group rule updated ['f200aa37-bea6-4cb6-9ecd-ae113e3bc548'] Oct 09 01:02:16.228150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:16Z,description=,direction='ingress',ethertype='IPv6',id=7f177b47-a26a-4cb3-9117-f12134355152,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5562380a08c440759380988a5b2d0b7c',protocol=,remote_address_group_id=,remote_group_id=f200aa37-bea6-4cb6-9ecd-ae113e3bc548,remote_ip_prefix=,revision_number=0,security_group_id=f200aa37-bea6-4cb6-9ecd-ae113e3bc548,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.228501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7f177b47-a26a-4cb3-9117-f12134355152), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.228828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7aa4a11b-1560-4a98-8a94-6ca0678af411 admin admin] Security group rule updated ['f200aa37-bea6-4cb6-9ecd-ae113e3bc548'] Oct 09 01:02:16.361997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Resource SecurityGroup deleted: f200aa37-bea6-4cb6-9ecd-ae113e3bc548 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.362516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (f200aa37-bea6-4cb6-9ecd-ae113e3bc548), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.363383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f200aa37-bea6-4cb6-9ecd-ae113e3bc548',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:16.377795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f200aa37-bea6-4cb6-9ecd-ae113e3bc548',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:16.379150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Resource SecurityGroupRule deleted: 337e2915-d20b-4c45-a889-794de72a360e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.379892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (337e2915-d20b-4c45-a889-794de72a360e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.380521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Security group rule updated ['f200aa37-bea6-4cb6-9ecd-ae113e3bc548'] Oct 09 01:02:16.381035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Resource SecurityGroupRule deleted: 4bfe7bdc-dc28-4cb3-909e-26bd297a0de3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.381319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4bfe7bdc-dc28-4cb3-909e-26bd297a0de3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.381647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Security group rule updated ['f200aa37-bea6-4cb6-9ecd-ae113e3bc548'] Oct 09 01:02:16.382165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Resource SecurityGroupRule deleted: 67b08924-e512-4c28-a9f7-49a65a78acbe {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.382504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (67b08924-e512-4c28-a9f7-49a65a78acbe), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.382831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Security group rule updated ['f200aa37-bea6-4cb6-9ecd-ae113e3bc548'] Oct 09 01:02:16.383244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Resource SecurityGroupRule deleted: 7f177b47-a26a-4cb3-9117-f12134355152 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.383725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7f177b47-a26a-4cb3-9117-f12134355152), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.384116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b76d604b-7f82-4e6f-835b-1569bca39550 admin admin] Security group rule updated ['f200aa37-bea6-4cb6-9ecd-ae113e3bc548'] Oct 09 01:02:16.576535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:16Z,description='Default security group',id=5d0d5793-48e9-48e7-80fd-b5c63b8d24db,is_default=True,name='default',project_id='14ebedb8f9674385bd92ce92b8c3577a',revision_number=1,rules=[SecurityGroupRule(7cbbdb83-d427-497d-b0d4-1d39b366dbfc),SecurityGroupRule(8cc08541-0180-4a3b-91c5-909498ca8321),SecurityGroupRule(b182c0cd-7d88-4fb0-8fa1-8c3de760e641),SecurityGroupRule(b8fa480d-6ad2-44fe-a8fa-14d5d12fba5b)],shared=False,stateful=True,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.577026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (5d0d5793-48e9-48e7-80fd-b5c63b8d24db), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.578152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:16Z,description=,direction='egress',ethertype='IPv4',id=7cbbdb83-d427-497d-b0d4-1d39b366dbfc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='14ebedb8f9674385bd92ce92b8c3577a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5d0d5793-48e9-48e7-80fd-b5c63b8d24db,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.578577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7cbbdb83-d427-497d-b0d4-1d39b366dbfc), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.578981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Security group rule updated ['5d0d5793-48e9-48e7-80fd-b5c63b8d24db'] Oct 09 01:02:16.579810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:16Z,description=,direction='ingress',ethertype='IPv6',id=8cc08541-0180-4a3b-91c5-909498ca8321,normalized_cidr=None,port_range_max=,port_range_min=,project_id='14ebedb8f9674385bd92ce92b8c3577a',protocol=,remote_address_group_id=,remote_group_id=5d0d5793-48e9-48e7-80fd-b5c63b8d24db,remote_ip_prefix=,revision_number=0,security_group_id=5d0d5793-48e9-48e7-80fd-b5c63b8d24db,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.580372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8cc08541-0180-4a3b-91c5-909498ca8321), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.580804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Security group rule updated ['5d0d5793-48e9-48e7-80fd-b5c63b8d24db'] Oct 09 01:02:16.582123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:16Z,description=,direction='ingress',ethertype='IPv4',id=b182c0cd-7d88-4fb0-8fa1-8c3de760e641,normalized_cidr=None,port_range_max=,port_range_min=,project_id='14ebedb8f9674385bd92ce92b8c3577a',protocol=,remote_address_group_id=,remote_group_id=5d0d5793-48e9-48e7-80fd-b5c63b8d24db,remote_ip_prefix=,revision_number=0,security_group_id=5d0d5793-48e9-48e7-80fd-b5c63b8d24db,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.582820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b182c0cd-7d88-4fb0-8fa1-8c3de760e641), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.583099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Security group rule updated ['5d0d5793-48e9-48e7-80fd-b5c63b8d24db'] Oct 09 01:02:16.583847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:16Z,description=,direction='egress',ethertype='IPv6',id=b8fa480d-6ad2-44fe-a8fa-14d5d12fba5b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='14ebedb8f9674385bd92ce92b8c3577a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5d0d5793-48e9-48e7-80fd-b5c63b8d24db,updated_at=2022-10-09T01:02:16Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:16.584300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b8fa480d-6ad2-44fe-a8fa-14d5d12fba5b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.584776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a265e6d0-b8f7-4176-af03-46e4f8de8288 admin admin] Security group rule updated ['5d0d5793-48e9-48e7-80fd-b5c63b8d24db'] Oct 09 01:02:16.721329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Resource SecurityGroup deleted: 5d0d5793-48e9-48e7-80fd-b5c63b8d24db {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.721711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (5d0d5793-48e9-48e7-80fd-b5c63b8d24db), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.722791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5d0d5793-48e9-48e7-80fd-b5c63b8d24db',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:16.740229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5d0d5793-48e9-48e7-80fd-b5c63b8d24db',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:16.740889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Resource SecurityGroupRule deleted: 7cbbdb83-d427-497d-b0d4-1d39b366dbfc {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.741323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7cbbdb83-d427-497d-b0d4-1d39b366dbfc), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.741893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Security group rule updated ['5d0d5793-48e9-48e7-80fd-b5c63b8d24db'] Oct 09 01:02:16.742621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Resource SecurityGroupRule deleted: 8cc08541-0180-4a3b-91c5-909498ca8321 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.743044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8cc08541-0180-4a3b-91c5-909498ca8321), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.744443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Security group rule updated ['5d0d5793-48e9-48e7-80fd-b5c63b8d24db'] Oct 09 01:02:16.744871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Resource SecurityGroupRule deleted: b182c0cd-7d88-4fb0-8fa1-8c3de760e641 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.745218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b182c0cd-7d88-4fb0-8fa1-8c3de760e641), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.745589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Security group rule updated ['5d0d5793-48e9-48e7-80fd-b5c63b8d24db'] Oct 09 01:02:16.745979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Resource SecurityGroupRule deleted: b8fa480d-6ad2-44fe-a8fa-14d5d12fba5b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:16.746320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b8fa480d-6ad2-44fe-a8fa-14d5d12fba5b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:16.746661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2e27da30-2bad-45a6-8775-cb208a452a92 admin admin] Security group rule updated ['5d0d5793-48e9-48e7-80fd-b5c63b8d24db'] Oct 09 01:02:16.832759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:431 started Oct 09 01:02:16.835206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=156000000,duration_sec=879,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:16.836046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:16.836406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:431 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:18.834180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:432 started Oct 09 01:02:18.836909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=158000000,duration_sec=881,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:18.837475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:18.837822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:432 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:19.021051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:18Z,description='Default security group',id=0969fb25-c929-49e1-8327-8160354ce619,is_default=True,name='default',project_id='fac6b6c986e8486fad370ebb71e08461',revision_number=1,rules=[SecurityGroupRule(57813573-b267-45e2-a6d5-a913fcbea633),SecurityGroupRule(583b8d8a-29ac-4fae-a218-d53184b730f0),SecurityGroupRule(de98e8c3-4a54-451d-a7c0-ef9458799bf3),SecurityGroupRule(dfcc6f72-6fe4-4471-90ae-bcae346f05c3)],shared=False,stateful=True,updated_at=2022-10-09T01:02:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.021526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (0969fb25-c929-49e1-8327-8160354ce619), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.022663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:18Z,description=,direction='egress',ethertype='IPv4',id=57813573-b267-45e2-a6d5-a913fcbea633,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fac6b6c986e8486fad370ebb71e08461',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0969fb25-c929-49e1-8327-8160354ce619,updated_at=2022-10-09T01:02:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.023027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (57813573-b267-45e2-a6d5-a913fcbea633), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.023369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Security group rule updated ['0969fb25-c929-49e1-8327-8160354ce619'] Oct 09 01:02:19.024083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:18Z,description=,direction='ingress',ethertype='IPv4',id=583b8d8a-29ac-4fae-a218-d53184b730f0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fac6b6c986e8486fad370ebb71e08461',protocol=,remote_address_group_id=,remote_group_id=0969fb25-c929-49e1-8327-8160354ce619,remote_ip_prefix=,revision_number=0,security_group_id=0969fb25-c929-49e1-8327-8160354ce619,updated_at=2022-10-09T01:02:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.024435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (583b8d8a-29ac-4fae-a218-d53184b730f0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.024767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Security group rule updated ['0969fb25-c929-49e1-8327-8160354ce619'] Oct 09 01:02:19.025430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:18Z,description=,direction='egress',ethertype='IPv6',id=de98e8c3-4a54-451d-a7c0-ef9458799bf3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fac6b6c986e8486fad370ebb71e08461',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0969fb25-c929-49e1-8327-8160354ce619,updated_at=2022-10-09T01:02:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.026047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (de98e8c3-4a54-451d-a7c0-ef9458799bf3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.026375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Security group rule updated ['0969fb25-c929-49e1-8327-8160354ce619'] Oct 09 01:02:19.027067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:18Z,description=,direction='ingress',ethertype='IPv6',id=dfcc6f72-6fe4-4471-90ae-bcae346f05c3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fac6b6c986e8486fad370ebb71e08461',protocol=,remote_address_group_id=,remote_group_id=0969fb25-c929-49e1-8327-8160354ce619,remote_ip_prefix=,revision_number=0,security_group_id=0969fb25-c929-49e1-8327-8160354ce619,updated_at=2022-10-09T01:02:18Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.027418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (dfcc6f72-6fe4-4471-90ae-bcae346f05c3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.027768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11faadc5-1727-4754-89ff-7c5a5dfebae8 admin admin] Security group rule updated ['0969fb25-c929-49e1-8327-8160354ce619'] Oct 09 01:02:19.147387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Resource SecurityGroup deleted: 0969fb25-c929-49e1-8327-8160354ce619 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.148001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (0969fb25-c929-49e1-8327-8160354ce619), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.148462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0969fb25-c929-49e1-8327-8160354ce619',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:19.161977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0969fb25-c929-49e1-8327-8160354ce619',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:19.162680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Resource SecurityGroupRule deleted: 57813573-b267-45e2-a6d5-a913fcbea633 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.163015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (57813573-b267-45e2-a6d5-a913fcbea633), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.163415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Security group rule updated ['0969fb25-c929-49e1-8327-8160354ce619'] Oct 09 01:02:19.164185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Resource SecurityGroupRule deleted: 583b8d8a-29ac-4fae-a218-d53184b730f0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.164444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (583b8d8a-29ac-4fae-a218-d53184b730f0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.164850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Security group rule updated ['0969fb25-c929-49e1-8327-8160354ce619'] Oct 09 01:02:19.165300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Resource SecurityGroupRule deleted: de98e8c3-4a54-451d-a7c0-ef9458799bf3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.165710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (de98e8c3-4a54-451d-a7c0-ef9458799bf3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.166096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Security group rule updated ['0969fb25-c929-49e1-8327-8160354ce619'] Oct 09 01:02:19.166531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Resource SecurityGroupRule deleted: dfcc6f72-6fe4-4471-90ae-bcae346f05c3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.166988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (dfcc6f72-6fe4-4471-90ae-bcae346f05c3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.167369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-93ffc6b0-975a-4d92-ba29-431ee49c2751 admin admin] Security group rule updated ['0969fb25-c929-49e1-8327-8160354ce619'] Oct 09 01:02:19.669660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:19Z,description='Default security group',id=8f5517f2-c822-4a08-95c4-402add2b0ceb,is_default=True,name='default',project_id='e0234fb64deb44aa863cd507930e41f3',revision_number=1,rules=[SecurityGroupRule(05cd95ff-1099-40cc-995e-acda4cd0307e),SecurityGroupRule(acbc363e-3cf0-48a7-81cd-fc3c50d2e6b4),SecurityGroupRule(ce213a85-4e7c-4e1a-a670-91c21a4fe827),SecurityGroupRule(db8a3d97-df66-42f3-9287-134709b30180)],shared=False,stateful=True,updated_at=2022-10-09T01:02:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.671241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (8f5517f2-c822-4a08-95c4-402add2b0ceb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.672339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:19Z,description=,direction='egress',ethertype='IPv6',id=05cd95ff-1099-40cc-995e-acda4cd0307e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e0234fb64deb44aa863cd507930e41f3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8f5517f2-c822-4a08-95c4-402add2b0ceb,updated_at=2022-10-09T01:02:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.672777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (05cd95ff-1099-40cc-995e-acda4cd0307e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.673068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Security group rule updated ['8f5517f2-c822-4a08-95c4-402add2b0ceb'] Oct 09 01:02:19.673923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:19Z,description=,direction='ingress',ethertype='IPv6',id=acbc363e-3cf0-48a7-81cd-fc3c50d2e6b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e0234fb64deb44aa863cd507930e41f3',protocol=,remote_address_group_id=,remote_group_id=8f5517f2-c822-4a08-95c4-402add2b0ceb,remote_ip_prefix=,revision_number=0,security_group_id=8f5517f2-c822-4a08-95c4-402add2b0ceb,updated_at=2022-10-09T01:02:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.674246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (acbc363e-3cf0-48a7-81cd-fc3c50d2e6b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.674619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Security group rule updated ['8f5517f2-c822-4a08-95c4-402add2b0ceb'] Oct 09 01:02:19.675398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:19Z,description=,direction='ingress',ethertype='IPv4',id=ce213a85-4e7c-4e1a-a670-91c21a4fe827,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e0234fb64deb44aa863cd507930e41f3',protocol=,remote_address_group_id=,remote_group_id=8f5517f2-c822-4a08-95c4-402add2b0ceb,remote_ip_prefix=,revision_number=0,security_group_id=8f5517f2-c822-4a08-95c4-402add2b0ceb,updated_at=2022-10-09T01:02:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.675956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ce213a85-4e7c-4e1a-a670-91c21a4fe827), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.676285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Security group rule updated ['8f5517f2-c822-4a08-95c4-402add2b0ceb'] Oct 09 01:02:19.677118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:19Z,description=,direction='egress',ethertype='IPv4',id=db8a3d97-df66-42f3-9287-134709b30180,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e0234fb64deb44aa863cd507930e41f3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8f5517f2-c822-4a08-95c4-402add2b0ceb,updated_at=2022-10-09T01:02:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:19.677460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (db8a3d97-df66-42f3-9287-134709b30180), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.677951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7402de9c-1773-4d55-ab97-bd66f972dbd8 admin admin] Security group rule updated ['8f5517f2-c822-4a08-95c4-402add2b0ceb'] Oct 09 01:02:19.803258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Resource SecurityGroup deleted: 8f5517f2-c822-4a08-95c4-402add2b0ceb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.803888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (8f5517f2-c822-4a08-95c4-402add2b0ceb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.804377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8f5517f2-c822-4a08-95c4-402add2b0ceb',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:19.817187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8f5517f2-c822-4a08-95c4-402add2b0ceb',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:19.817727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Resource SecurityGroupRule deleted: 05cd95ff-1099-40cc-995e-acda4cd0307e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.818100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (05cd95ff-1099-40cc-995e-acda4cd0307e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.818435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Security group rule updated ['8f5517f2-c822-4a08-95c4-402add2b0ceb'] Oct 09 01:02:19.818824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Resource SecurityGroupRule deleted: acbc363e-3cf0-48a7-81cd-fc3c50d2e6b4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.819336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (acbc363e-3cf0-48a7-81cd-fc3c50d2e6b4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.819678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Security group rule updated ['8f5517f2-c822-4a08-95c4-402add2b0ceb'] Oct 09 01:02:19.820051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Resource SecurityGroupRule deleted: ce213a85-4e7c-4e1a-a670-91c21a4fe827 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.820389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ce213a85-4e7c-4e1a-a670-91c21a4fe827), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.820731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Security group rule updated ['8f5517f2-c822-4a08-95c4-402add2b0ceb'] Oct 09 01:02:19.821096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Resource SecurityGroupRule deleted: db8a3d97-df66-42f3-9287-134709b30180 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:19.821433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (db8a3d97-df66-42f3-9287-134709b30180), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:19.821746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-550c72ef-b735-4032-b190-cea12188e63a admin admin] Security group rule updated ['8f5517f2-c822-4a08-95c4-402add2b0ceb'] Oct 09 01:02:20.834355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:433 started Oct 09 01:02:20.837292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=158000000,duration_sec=883,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:20.838302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:20.838659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:433 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:02:22.043071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:21Z,description='Default security group',id=61cb90f5-3dec-4a44-ac6a-2b29138677cb,is_default=True,name='default',project_id='3b2b4af9a4d64827b537860ce1cd150f',revision_number=1,rules=[SecurityGroupRule(09b4af26-a702-4613-be9a-89edbbbf7d56),SecurityGroupRule(5d7c0fb5-8e32-4bc1-9382-6387fb6f7d03),SecurityGroupRule(b5c41d2d-e464-4878-b514-3c423ae9e2b9),SecurityGroupRule(ce14adee-fbeb-4ade-a58f-0dbaf703eb2d)],shared=False,stateful=True,updated_at=2022-10-09T01:02:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.043740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (61cb90f5-3dec-4a44-ac6a-2b29138677cb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.044373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:21Z,description=,direction='egress',ethertype='IPv4',id=09b4af26-a702-4613-be9a-89edbbbf7d56,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b2b4af9a4d64827b537860ce1cd150f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=61cb90f5-3dec-4a44-ac6a-2b29138677cb,updated_at=2022-10-09T01:02:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.044466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (09b4af26-a702-4613-be9a-89edbbbf7d56), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.044798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Security group rule updated ['61cb90f5-3dec-4a44-ac6a-2b29138677cb'] Oct 09 01:02:22.045470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:21Z,description=,direction='ingress',ethertype='IPv6',id=5d7c0fb5-8e32-4bc1-9382-6387fb6f7d03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b2b4af9a4d64827b537860ce1cd150f',protocol=,remote_address_group_id=,remote_group_id=61cb90f5-3dec-4a44-ac6a-2b29138677cb,remote_ip_prefix=,revision_number=0,security_group_id=61cb90f5-3dec-4a44-ac6a-2b29138677cb,updated_at=2022-10-09T01:02:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.045851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5d7c0fb5-8e32-4bc1-9382-6387fb6f7d03), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.046171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Security group rule updated ['61cb90f5-3dec-4a44-ac6a-2b29138677cb'] Oct 09 01:02:22.046815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:21Z,description=,direction='egress',ethertype='IPv6',id=b5c41d2d-e464-4878-b514-3c423ae9e2b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b2b4af9a4d64827b537860ce1cd150f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=61cb90f5-3dec-4a44-ac6a-2b29138677cb,updated_at=2022-10-09T01:02:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.047164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b5c41d2d-e464-4878-b514-3c423ae9e2b9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.047484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Security group rule updated ['61cb90f5-3dec-4a44-ac6a-2b29138677cb'] Oct 09 01:02:22.048155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:21Z,description=,direction='ingress',ethertype='IPv4',id=ce14adee-fbeb-4ade-a58f-0dbaf703eb2d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b2b4af9a4d64827b537860ce1cd150f',protocol=,remote_address_group_id=,remote_group_id=61cb90f5-3dec-4a44-ac6a-2b29138677cb,remote_ip_prefix=,revision_number=0,security_group_id=61cb90f5-3dec-4a44-ac6a-2b29138677cb,updated_at=2022-10-09T01:02:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.048499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ce14adee-fbeb-4ade-a58f-0dbaf703eb2d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.048818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-680cb8b4-7d25-49b1-807d-8ef3f2b7389b admin admin] Security group rule updated ['61cb90f5-3dec-4a44-ac6a-2b29138677cb'] Oct 09 01:02:22.175338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Resource SecurityGroup deleted: 61cb90f5-3dec-4a44-ac6a-2b29138677cb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.175774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (61cb90f5-3dec-4a44-ac6a-2b29138677cb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.176247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('61cb90f5-3dec-4a44-ac6a-2b29138677cb',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:22.189260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('61cb90f5-3dec-4a44-ac6a-2b29138677cb',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:22.189711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Resource SecurityGroupRule deleted: 09b4af26-a702-4613-be9a-89edbbbf7d56 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.190072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (09b4af26-a702-4613-be9a-89edbbbf7d56), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.190460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Security group rule updated ['61cb90f5-3dec-4a44-ac6a-2b29138677cb'] Oct 09 01:02:22.191363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Resource SecurityGroupRule deleted: 5d7c0fb5-8e32-4bc1-9382-6387fb6f7d03 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.191741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5d7c0fb5-8e32-4bc1-9382-6387fb6f7d03), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.192062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Security group rule updated ['61cb90f5-3dec-4a44-ac6a-2b29138677cb'] Oct 09 01:02:22.192427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Resource SecurityGroupRule deleted: b5c41d2d-e464-4878-b514-3c423ae9e2b9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.192764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b5c41d2d-e464-4878-b514-3c423ae9e2b9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.193222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Security group rule updated ['61cb90f5-3dec-4a44-ac6a-2b29138677cb'] Oct 09 01:02:22.193593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Resource SecurityGroupRule deleted: ce14adee-fbeb-4ade-a58f-0dbaf703eb2d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.194028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ce14adee-fbeb-4ade-a58f-0dbaf703eb2d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.194370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-45dde6c3-a75e-45b7-bb6a-5d590c2c315c admin admin] Security group rule updated ['61cb90f5-3dec-4a44-ac6a-2b29138677cb'] Oct 09 01:02:22.564883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:22Z,description='Default security group',id=c9f8269d-6a81-4c5f-8dba-e26a564a0d98,is_default=True,name='default',project_id='c3ad9a857bbc452087cfdabcb9c98aff',revision_number=1,rules=[SecurityGroupRule(509a6d87-b29c-46a1-a4a2-0219254db2f7),SecurityGroupRule(6d6a5e7b-bec7-4f92-87e6-ea5b214e7d29),SecurityGroupRule(8287c807-bdb8-44f8-8dbf-0f884bf7d7a3),SecurityGroupRule(f1270f41-b719-4b9d-8c2a-331c325dd9db)],shared=False,stateful=True,updated_at=2022-10-09T01:02:22Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.565266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (c9f8269d-6a81-4c5f-8dba-e26a564a0d98), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.566409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:22Z,description=,direction='ingress',ethertype='IPv4',id=509a6d87-b29c-46a1-a4a2-0219254db2f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3ad9a857bbc452087cfdabcb9c98aff',protocol=,remote_address_group_id=,remote_group_id=c9f8269d-6a81-4c5f-8dba-e26a564a0d98,remote_ip_prefix=,revision_number=0,security_group_id=c9f8269d-6a81-4c5f-8dba-e26a564a0d98,updated_at=2022-10-09T01:02:22Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.566768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (509a6d87-b29c-46a1-a4a2-0219254db2f7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.567110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Security group rule updated ['c9f8269d-6a81-4c5f-8dba-e26a564a0d98'] Oct 09 01:02:22.567806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:22Z,description=,direction='egress',ethertype='IPv6',id=6d6a5e7b-bec7-4f92-87e6-ea5b214e7d29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3ad9a857bbc452087cfdabcb9c98aff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c9f8269d-6a81-4c5f-8dba-e26a564a0d98,updated_at=2022-10-09T01:02:22Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.568161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6d6a5e7b-bec7-4f92-87e6-ea5b214e7d29), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.568509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Security group rule updated ['c9f8269d-6a81-4c5f-8dba-e26a564a0d98'] Oct 09 01:02:22.569277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:22Z,description=,direction='egress',ethertype='IPv4',id=8287c807-bdb8-44f8-8dbf-0f884bf7d7a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3ad9a857bbc452087cfdabcb9c98aff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c9f8269d-6a81-4c5f-8dba-e26a564a0d98,updated_at=2022-10-09T01:02:22Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.569632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8287c807-bdb8-44f8-8dbf-0f884bf7d7a3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.569959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Security group rule updated ['c9f8269d-6a81-4c5f-8dba-e26a564a0d98'] Oct 09 01:02:22.570616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:22Z,description=,direction='ingress',ethertype='IPv6',id=f1270f41-b719-4b9d-8c2a-331c325dd9db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3ad9a857bbc452087cfdabcb9c98aff',protocol=,remote_address_group_id=,remote_group_id=c9f8269d-6a81-4c5f-8dba-e26a564a0d98,remote_ip_prefix=,revision_number=0,security_group_id=c9f8269d-6a81-4c5f-8dba-e26a564a0d98,updated_at=2022-10-09T01:02:22Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:22.570962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f1270f41-b719-4b9d-8c2a-331c325dd9db), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.571283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-04512dae-e44d-44a8-a78c-2b994a1c317d admin admin] Security group rule updated ['c9f8269d-6a81-4c5f-8dba-e26a564a0d98'] Oct 09 01:02:22.693149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Resource SecurityGroup deleted: c9f8269d-6a81-4c5f-8dba-e26a564a0d98 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.693528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (c9f8269d-6a81-4c5f-8dba-e26a564a0d98), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.693977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c9f8269d-6a81-4c5f-8dba-e26a564a0d98',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:22.706384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c9f8269d-6a81-4c5f-8dba-e26a564a0d98',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:22.706834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Resource SecurityGroupRule deleted: 509a6d87-b29c-46a1-a4a2-0219254db2f7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.707195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (509a6d87-b29c-46a1-a4a2-0219254db2f7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.707526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Security group rule updated ['c9f8269d-6a81-4c5f-8dba-e26a564a0d98'] Oct 09 01:02:22.707951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Resource SecurityGroupRule deleted: 6d6a5e7b-bec7-4f92-87e6-ea5b214e7d29 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.708296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6d6a5e7b-bec7-4f92-87e6-ea5b214e7d29), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.708613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Security group rule updated ['c9f8269d-6a81-4c5f-8dba-e26a564a0d98'] Oct 09 01:02:22.708984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Resource SecurityGroupRule deleted: 8287c807-bdb8-44f8-8dbf-0f884bf7d7a3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.709320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8287c807-bdb8-44f8-8dbf-0f884bf7d7a3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.709634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Security group rule updated ['c9f8269d-6a81-4c5f-8dba-e26a564a0d98'] Oct 09 01:02:22.710018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Resource SecurityGroupRule deleted: f1270f41-b719-4b9d-8c2a-331c325dd9db {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:22.710381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f1270f41-b719-4b9d-8c2a-331c325dd9db), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:22.710693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4cdee4ec-30f0-4803-95d7-4abb02492a59 admin admin] Security group rule updated ['c9f8269d-6a81-4c5f-8dba-e26a564a0d98'] Oct 09 01:02:22.834967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:434 started Oct 09 01:02:22.838376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=159000000,duration_sec=885,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:22.839012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:22.839435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:434 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:02:23.405762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:23Z,description='Default security group',id=6ad2379d-c17a-45a4-88de-83ff47e25fb4,is_default=True,name='default',project_id='fdc49ce807cc48cdab1aaf875a9b2343',revision_number=1,rules=[SecurityGroupRule(17679008-ba02-4d81-a170-fc0d4b0cddd0),SecurityGroupRule(1e7ac405-bcde-4782-8ba2-64379448357d),SecurityGroupRule(442eaf71-1fab-4f72-bea4-34747d0db59d),SecurityGroupRule(fa71a372-6cce-405f-94ee-2e7c4e9043fa)],shared=False,stateful=True,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.406417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (6ad2379d-c17a-45a4-88de-83ff47e25fb4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.407251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:23Z,description=,direction='egress',ethertype='IPv4',id=17679008-ba02-4d81-a170-fc0d4b0cddd0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fdc49ce807cc48cdab1aaf875a9b2343',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6ad2379d-c17a-45a4-88de-83ff47e25fb4,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.407740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (17679008-ba02-4d81-a170-fc0d4b0cddd0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.408289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Security group rule updated ['6ad2379d-c17a-45a4-88de-83ff47e25fb4'] Oct 09 01:02:23.410477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:23Z,description=,direction='ingress',ethertype='IPv6',id=1e7ac405-bcde-4782-8ba2-64379448357d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fdc49ce807cc48cdab1aaf875a9b2343',protocol=,remote_address_group_id=,remote_group_id=6ad2379d-c17a-45a4-88de-83ff47e25fb4,remote_ip_prefix=,revision_number=0,security_group_id=6ad2379d-c17a-45a4-88de-83ff47e25fb4,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.410837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1e7ac405-bcde-4782-8ba2-64379448357d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.411575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Security group rule updated ['6ad2379d-c17a-45a4-88de-83ff47e25fb4'] Oct 09 01:02:23.412278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:23Z,description=,direction='ingress',ethertype='IPv4',id=442eaf71-1fab-4f72-bea4-34747d0db59d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fdc49ce807cc48cdab1aaf875a9b2343',protocol=,remote_address_group_id=,remote_group_id=6ad2379d-c17a-45a4-88de-83ff47e25fb4,remote_ip_prefix=,revision_number=0,security_group_id=6ad2379d-c17a-45a4-88de-83ff47e25fb4,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.412632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (442eaf71-1fab-4f72-bea4-34747d0db59d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.413260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Security group rule updated ['6ad2379d-c17a-45a4-88de-83ff47e25fb4'] Oct 09 01:02:23.413924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:23Z,description=,direction='egress',ethertype='IPv6',id=fa71a372-6cce-405f-94ee-2e7c4e9043fa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fdc49ce807cc48cdab1aaf875a9b2343',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6ad2379d-c17a-45a4-88de-83ff47e25fb4,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.414458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fa71a372-6cce-405f-94ee-2e7c4e9043fa), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.414789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c3219198-b08b-4bc9-8257-5288af3f5244 admin admin] Security group rule updated ['6ad2379d-c17a-45a4-88de-83ff47e25fb4'] Oct 09 01:02:23.548230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Resource SecurityGroup deleted: 6ad2379d-c17a-45a4-88de-83ff47e25fb4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:23.548830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (6ad2379d-c17a-45a4-88de-83ff47e25fb4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.549285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6ad2379d-c17a-45a4-88de-83ff47e25fb4',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:23.567019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6ad2379d-c17a-45a4-88de-83ff47e25fb4',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:23.567666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Resource SecurityGroupRule deleted: 17679008-ba02-4d81-a170-fc0d4b0cddd0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:23.568041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (17679008-ba02-4d81-a170-fc0d4b0cddd0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.568374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Security group rule updated ['6ad2379d-c17a-45a4-88de-83ff47e25fb4'] Oct 09 01:02:23.568764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Resource SecurityGroupRule deleted: 1e7ac405-bcde-4782-8ba2-64379448357d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:23.569106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1e7ac405-bcde-4782-8ba2-64379448357d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.569581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Security group rule updated ['6ad2379d-c17a-45a4-88de-83ff47e25fb4'] Oct 09 01:02:23.570129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Resource SecurityGroupRule deleted: 442eaf71-1fab-4f72-bea4-34747d0db59d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:23.570471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (442eaf71-1fab-4f72-bea4-34747d0db59d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.570788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Security group rule updated ['6ad2379d-c17a-45a4-88de-83ff47e25fb4'] Oct 09 01:02:23.571156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Resource SecurityGroupRule deleted: fa71a372-6cce-405f-94ee-2e7c4e9043fa {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:23.574497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fa71a372-6cce-405f-94ee-2e7c4e9043fa), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.575036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-59ff6de1-8bbd-4fd0-9d42-b80748cdc4ce admin admin] Security group rule updated ['6ad2379d-c17a-45a4-88de-83ff47e25fb4'] Oct 09 01:02:23.966900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:23Z,description='Default security group',id=bcdf6d27-c6b9-4426-b212-db6120c3488a,is_default=True,name='default',project_id='f33d8f9b267a4690b9b8f4caf65222fd',revision_number=1,rules=[SecurityGroupRule(5f504ad2-7788-4673-91f8-f909a16533c1),SecurityGroupRule(6384c8fd-50d4-4da4-901d-dd31a6d211dd),SecurityGroupRule(7e1f3193-9b99-460f-9c32-820b042381e7),SecurityGroupRule(b02b28c6-b7e0-4f56-9621-ff47cd010b37)],shared=False,stateful=True,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.967363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (bcdf6d27-c6b9-4426-b212-db6120c3488a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.968115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:23Z,description=,direction='egress',ethertype='IPv6',id=5f504ad2-7788-4673-91f8-f909a16533c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f33d8f9b267a4690b9b8f4caf65222fd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bcdf6d27-c6b9-4426-b212-db6120c3488a,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.968671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5f504ad2-7788-4673-91f8-f909a16533c1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.969173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Security group rule updated ['bcdf6d27-c6b9-4426-b212-db6120c3488a'] Oct 09 01:02:23.970049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:23Z,description=,direction='ingress',ethertype='IPv4',id=6384c8fd-50d4-4da4-901d-dd31a6d211dd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f33d8f9b267a4690b9b8f4caf65222fd',protocol=,remote_address_group_id=,remote_group_id=bcdf6d27-c6b9-4426-b212-db6120c3488a,remote_ip_prefix=,revision_number=0,security_group_id=bcdf6d27-c6b9-4426-b212-db6120c3488a,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.970407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6384c8fd-50d4-4da4-901d-dd31a6d211dd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.970742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Security group rule updated ['bcdf6d27-c6b9-4426-b212-db6120c3488a'] Oct 09 01:02:23.971405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:23Z,description=,direction='egress',ethertype='IPv4',id=7e1f3193-9b99-460f-9c32-820b042381e7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f33d8f9b267a4690b9b8f4caf65222fd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bcdf6d27-c6b9-4426-b212-db6120c3488a,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.972096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7e1f3193-9b99-460f-9c32-820b042381e7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.972621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Security group rule updated ['bcdf6d27-c6b9-4426-b212-db6120c3488a'] Oct 09 01:02:23.973216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:23Z,description=,direction='ingress',ethertype='IPv6',id=b02b28c6-b7e0-4f56-9621-ff47cd010b37,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f33d8f9b267a4690b9b8f4caf65222fd',protocol=,remote_address_group_id=,remote_group_id=bcdf6d27-c6b9-4426-b212-db6120c3488a,remote_ip_prefix=,revision_number=0,security_group_id=bcdf6d27-c6b9-4426-b212-db6120c3488a,updated_at=2022-10-09T01:02:23Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:23.973576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b02b28c6-b7e0-4f56-9621-ff47cd010b37), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:23.973907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2facded4-dc5e-40b2-b98f-dfe38a5f0968 admin admin] Security group rule updated ['bcdf6d27-c6b9-4426-b212-db6120c3488a'] Oct 09 01:02:24.101398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Resource SecurityGroup deleted: bcdf6d27-c6b9-4426-b212-db6120c3488a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:24.101784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (bcdf6d27-c6b9-4426-b212-db6120c3488a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:24.102239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bcdf6d27-c6b9-4426-b212-db6120c3488a',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:24.116089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bcdf6d27-c6b9-4426-b212-db6120c3488a',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:24.117084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Resource SecurityGroupRule deleted: 5f504ad2-7788-4673-91f8-f909a16533c1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:24.117451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5f504ad2-7788-4673-91f8-f909a16533c1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:24.117780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Security group rule updated ['bcdf6d27-c6b9-4426-b212-db6120c3488a'] Oct 09 01:02:24.118173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Resource SecurityGroupRule deleted: 6384c8fd-50d4-4da4-901d-dd31a6d211dd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:24.118513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6384c8fd-50d4-4da4-901d-dd31a6d211dd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:24.118829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Security group rule updated ['bcdf6d27-c6b9-4426-b212-db6120c3488a'] Oct 09 01:02:24.119191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Resource SecurityGroupRule deleted: 7e1f3193-9b99-460f-9c32-820b042381e7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:24.119527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7e1f3193-9b99-460f-9c32-820b042381e7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:24.119874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Security group rule updated ['bcdf6d27-c6b9-4426-b212-db6120c3488a'] Oct 09 01:02:24.120234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Resource SecurityGroupRule deleted: b02b28c6-b7e0-4f56-9621-ff47cd010b37 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:24.120568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b02b28c6-b7e0-4f56-9621-ff47cd010b37), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:24.120876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-31f1ce37-c7aa-48d1-a66d-4e71efaaa5f5 admin admin] Security group rule updated ['bcdf6d27-c6b9-4426-b212-db6120c3488a'] Oct 09 01:02:24.836279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:435 started Oct 09 01:02:24.839208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efcc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=160000000,duration_sec=887,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:24.839807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:24.840160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:435 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:26.836759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:436 started Oct 09 01:02:26.839484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=160000000,duration_sec=889,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:26.840076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:26.840426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:436 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:28.838135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:437 started Oct 09 01:02:28.842294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=163000000,duration_sec=891,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:28.842918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:28.843625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:437 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 01:02:30.839531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:438 started Oct 09 01:02:30.842066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=163000000,duration_sec=893,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:30.842601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:30.842954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:438 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:32.840222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:439 started Oct 09 01:02:32.846965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=164000000,duration_sec=895,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:32.847531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:32.847923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:439 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:02:34.168005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:34Z,description='Default security group',id=0ec33574-cb24-4fba-87a6-df19af4dbb07,is_default=True,name='default',project_id='6b037d8bc6e240f7a981facfd03c639d',revision_number=1,rules=[SecurityGroupRule(34985891-8a52-4e62-84d0-e13f979354ff),SecurityGroupRule(38bdc7a1-5a02-456c-8120-d6e2125b4cf8),SecurityGroupRule(3be9fc6f-08bb-4070-8260-ff452cbd1077),SecurityGroupRule(f4da2199-76e3-453e-8efe-ae022787c247)],shared=False,stateful=True,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.168719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (0ec33574-cb24-4fba-87a6-df19af4dbb07), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.169409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:34Z,description=,direction='ingress',ethertype='IPv6',id=34985891-8a52-4e62-84d0-e13f979354ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6b037d8bc6e240f7a981facfd03c639d',protocol=,remote_address_group_id=,remote_group_id=0ec33574-cb24-4fba-87a6-df19af4dbb07,remote_ip_prefix=,revision_number=0,security_group_id=0ec33574-cb24-4fba-87a6-df19af4dbb07,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.169836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (34985891-8a52-4e62-84d0-e13f979354ff), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.170266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Security group rule updated ['0ec33574-cb24-4fba-87a6-df19af4dbb07'] Oct 09 01:02:34.171009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:34Z,description=,direction='egress',ethertype='IPv4',id=38bdc7a1-5a02-456c-8120-d6e2125b4cf8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6b037d8bc6e240f7a981facfd03c639d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ec33574-cb24-4fba-87a6-df19af4dbb07,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.171433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (38bdc7a1-5a02-456c-8120-d6e2125b4cf8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.171880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Security group rule updated ['0ec33574-cb24-4fba-87a6-df19af4dbb07'] Oct 09 01:02:34.172603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:34Z,description=,direction='egress',ethertype='IPv6',id=3be9fc6f-08bb-4070-8260-ff452cbd1077,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6b037d8bc6e240f7a981facfd03c639d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ec33574-cb24-4fba-87a6-df19af4dbb07,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.172964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3be9fc6f-08bb-4070-8260-ff452cbd1077), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.173288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Security group rule updated ['0ec33574-cb24-4fba-87a6-df19af4dbb07'] Oct 09 01:02:34.173951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:34Z,description=,direction='ingress',ethertype='IPv4',id=f4da2199-76e3-453e-8efe-ae022787c247,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6b037d8bc6e240f7a981facfd03c639d',protocol=,remote_address_group_id=,remote_group_id=0ec33574-cb24-4fba-87a6-df19af4dbb07,remote_ip_prefix=,revision_number=0,security_group_id=0ec33574-cb24-4fba-87a6-df19af4dbb07,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.174298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f4da2199-76e3-453e-8efe-ae022787c247), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.174636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1a0930f5-a01e-44b0-a16f-0db88b4c5d67 admin admin] Security group rule updated ['0ec33574-cb24-4fba-87a6-df19af4dbb07'] Oct 09 01:02:34.284840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Resource SecurityGroup deleted: 0ec33574-cb24-4fba-87a6-df19af4dbb07 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.285487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (0ec33574-cb24-4fba-87a6-df19af4dbb07), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.286029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0ec33574-cb24-4fba-87a6-df19af4dbb07',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:34.301271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0ec33574-cb24-4fba-87a6-df19af4dbb07',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:34.301831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Resource SecurityGroupRule deleted: 34985891-8a52-4e62-84d0-e13f979354ff {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.302305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (34985891-8a52-4e62-84d0-e13f979354ff), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.302801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Security group rule updated ['0ec33574-cb24-4fba-87a6-df19af4dbb07'] Oct 09 01:02:34.303200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Resource SecurityGroupRule deleted: 38bdc7a1-5a02-456c-8120-d6e2125b4cf8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.303689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (38bdc7a1-5a02-456c-8120-d6e2125b4cf8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.304039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Security group rule updated ['0ec33574-cb24-4fba-87a6-df19af4dbb07'] Oct 09 01:02:34.304404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Resource SecurityGroupRule deleted: 3be9fc6f-08bb-4070-8260-ff452cbd1077 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.304772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3be9fc6f-08bb-4070-8260-ff452cbd1077), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.305092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Security group rule updated ['0ec33574-cb24-4fba-87a6-df19af4dbb07'] Oct 09 01:02:34.305461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Resource SecurityGroupRule deleted: f4da2199-76e3-453e-8efe-ae022787c247 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.305805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f4da2199-76e3-453e-8efe-ae022787c247), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.306122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1e229d3-5789-4e41-825d-6b4e05e34d97 admin admin] Security group rule updated ['0ec33574-cb24-4fba-87a6-df19af4dbb07'] Oct 09 01:02:34.679160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:34Z,description='Default security group',id=b7e24188-8aba-4639-b257-90a6dd50e943,is_default=True,name='default',project_id='ff44ced9f1f241ad8b78680960b60f01',revision_number=1,rules=[SecurityGroupRule(0e8f3fe7-8e96-42be-bfe5-9da3dec6dd19),SecurityGroupRule(59c23c38-0aa9-4777-98f1-56c0d9925d76),SecurityGroupRule(98d218b4-b2e2-437b-be56-ba2654761700),SecurityGroupRule(e7c2818b-c70f-4727-a2be-004d4a0994de)],shared=False,stateful=True,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.679675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (b7e24188-8aba-4639-b257-90a6dd50e943), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.680488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:34Z,description=,direction='egress',ethertype='IPv4',id=0e8f3fe7-8e96-42be-bfe5-9da3dec6dd19,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ff44ced9f1f241ad8b78680960b60f01',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b7e24188-8aba-4639-b257-90a6dd50e943,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.680926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (0e8f3fe7-8e96-42be-bfe5-9da3dec6dd19), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.681485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Security group rule updated ['b7e24188-8aba-4639-b257-90a6dd50e943'] Oct 09 01:02:34.682861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:34Z,description=,direction='egress',ethertype='IPv6',id=59c23c38-0aa9-4777-98f1-56c0d9925d76,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ff44ced9f1f241ad8b78680960b60f01',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b7e24188-8aba-4639-b257-90a6dd50e943,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.683311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (59c23c38-0aa9-4777-98f1-56c0d9925d76), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.683748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Security group rule updated ['b7e24188-8aba-4639-b257-90a6dd50e943'] Oct 09 01:02:34.684430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:34Z,description=,direction='ingress',ethertype='IPv4',id=98d218b4-b2e2-437b-be56-ba2654761700,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ff44ced9f1f241ad8b78680960b60f01',protocol=,remote_address_group_id=,remote_group_id=b7e24188-8aba-4639-b257-90a6dd50e943,remote_ip_prefix=,revision_number=0,security_group_id=b7e24188-8aba-4639-b257-90a6dd50e943,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.684781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (98d218b4-b2e2-437b-be56-ba2654761700), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.685110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Security group rule updated ['b7e24188-8aba-4639-b257-90a6dd50e943'] Oct 09 01:02:34.685802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:34Z,description=,direction='ingress',ethertype='IPv6',id=e7c2818b-c70f-4727-a2be-004d4a0994de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ff44ced9f1f241ad8b78680960b60f01',protocol=,remote_address_group_id=,remote_group_id=b7e24188-8aba-4639-b257-90a6dd50e943,remote_ip_prefix=,revision_number=0,security_group_id=b7e24188-8aba-4639-b257-90a6dd50e943,updated_at=2022-10-09T01:02:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:34.686131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e7c2818b-c70f-4727-a2be-004d4a0994de), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.686456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6c500075-8c4d-443e-826d-b3ffdf1e5b39 admin admin] Security group rule updated ['b7e24188-8aba-4639-b257-90a6dd50e943'] Oct 09 01:02:34.804216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Resource SecurityGroup deleted: b7e24188-8aba-4639-b257-90a6dd50e943 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.804724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (b7e24188-8aba-4639-b257-90a6dd50e943), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.805272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b7e24188-8aba-4639-b257-90a6dd50e943',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:34.818449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b7e24188-8aba-4639-b257-90a6dd50e943',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:34.818981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Resource SecurityGroupRule deleted: 0e8f3fe7-8e96-42be-bfe5-9da3dec6dd19 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.819359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (0e8f3fe7-8e96-42be-bfe5-9da3dec6dd19), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.819746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Security group rule updated ['b7e24188-8aba-4639-b257-90a6dd50e943'] Oct 09 01:02:34.820326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Resource SecurityGroupRule deleted: 59c23c38-0aa9-4777-98f1-56c0d9925d76 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.820675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (59c23c38-0aa9-4777-98f1-56c0d9925d76), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.820999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Security group rule updated ['b7e24188-8aba-4639-b257-90a6dd50e943'] Oct 09 01:02:34.821372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Resource SecurityGroupRule deleted: 98d218b4-b2e2-437b-be56-ba2654761700 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.821716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (98d218b4-b2e2-437b-be56-ba2654761700), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.822068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Security group rule updated ['b7e24188-8aba-4639-b257-90a6dd50e943'] Oct 09 01:02:34.822433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Resource SecurityGroupRule deleted: e7c2818b-c70f-4727-a2be-004d4a0994de {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:34.822775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e7c2818b-c70f-4727-a2be-004d4a0994de), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:34.823092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4abd05c-5a3e-4124-af1d-cf0f720178ec admin admin] Security group rule updated ['b7e24188-8aba-4639-b257-90a6dd50e943'] Oct 09 01:02:34.841202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:440 started Oct 09 01:02:34.843797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=165000000,duration_sec=897,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:34.844534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:34.844892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:440 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:36.138509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:36Z,description='Default security group',id=0fc767b6-e687-4858-b561-63b49bb5c366,is_default=True,name='default',project_id='a343ee9be22e41a990e16ae84cc21d49',revision_number=1,rules=[SecurityGroupRule(2a743382-ec55-425e-bec5-8fb2b0630e34),SecurityGroupRule(cd275955-179c-416b-8807-c8ec12a37e70),SecurityGroupRule(f31557d8-1ee1-473a-947a-2d23ad1a2441),SecurityGroupRule(f92f4a7d-a3b8-4fce-b7b6-b4820dcd22ae)],shared=False,stateful=True,updated_at=2022-10-09T01:02:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:36.139217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (0fc767b6-e687-4858-b561-63b49bb5c366), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.139742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:36Z,description=,direction='egress',ethertype='IPv4',id=2a743382-ec55-425e-bec5-8fb2b0630e34,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a343ee9be22e41a990e16ae84cc21d49',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc767b6-e687-4858-b561-63b49bb5c366,updated_at=2022-10-09T01:02:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:36.140296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2a743382-ec55-425e-bec5-8fb2b0630e34), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.141006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Security group rule updated ['0fc767b6-e687-4858-b561-63b49bb5c366'] Oct 09 01:02:36.141333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:36Z,description=,direction='egress',ethertype='IPv6',id=cd275955-179c-416b-8807-c8ec12a37e70,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a343ee9be22e41a990e16ae84cc21d49',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc767b6-e687-4858-b561-63b49bb5c366,updated_at=2022-10-09T01:02:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:36.141642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (cd275955-179c-416b-8807-c8ec12a37e70), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.141972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Security group rule updated ['0fc767b6-e687-4858-b561-63b49bb5c366'] Oct 09 01:02:36.142617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:36Z,description=,direction='ingress',ethertype='IPv6',id=f31557d8-1ee1-473a-947a-2d23ad1a2441,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a343ee9be22e41a990e16ae84cc21d49',protocol=,remote_address_group_id=,remote_group_id=0fc767b6-e687-4858-b561-63b49bb5c366,remote_ip_prefix=,revision_number=0,security_group_id=0fc767b6-e687-4858-b561-63b49bb5c366,updated_at=2022-10-09T01:02:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:36.143129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f31557d8-1ee1-473a-947a-2d23ad1a2441), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.143755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Security group rule updated ['0fc767b6-e687-4858-b561-63b49bb5c366'] Oct 09 01:02:36.144764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:36Z,description=,direction='ingress',ethertype='IPv4',id=f92f4a7d-a3b8-4fce-b7b6-b4820dcd22ae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a343ee9be22e41a990e16ae84cc21d49',protocol=,remote_address_group_id=,remote_group_id=0fc767b6-e687-4858-b561-63b49bb5c366,remote_ip_prefix=,revision_number=0,security_group_id=0fc767b6-e687-4858-b561-63b49bb5c366,updated_at=2022-10-09T01:02:36Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:36.144967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f92f4a7d-a3b8-4fce-b7b6-b4820dcd22ae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.145322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-36cb388a-89f5-419e-8d28-5101599b3bd8 admin admin] Security group rule updated ['0fc767b6-e687-4858-b561-63b49bb5c366'] Oct 09 01:02:36.293852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Resource SecurityGroup deleted: 0fc767b6-e687-4858-b561-63b49bb5c366 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:36.294517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (0fc767b6-e687-4858-b561-63b49bb5c366), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.295058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0fc767b6-e687-4858-b561-63b49bb5c366',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:36.311514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0fc767b6-e687-4858-b561-63b49bb5c366',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:36.312017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Resource SecurityGroupRule deleted: 2a743382-ec55-425e-bec5-8fb2b0630e34 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:36.319539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2a743382-ec55-425e-bec5-8fb2b0630e34), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.319539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Security group rule updated ['0fc767b6-e687-4858-b561-63b49bb5c366'] Oct 09 01:02:36.319539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Resource SecurityGroupRule deleted: cd275955-179c-416b-8807-c8ec12a37e70 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:36.319539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (cd275955-179c-416b-8807-c8ec12a37e70), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.319539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Security group rule updated ['0fc767b6-e687-4858-b561-63b49bb5c366'] Oct 09 01:02:36.320160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Resource SecurityGroupRule deleted: f31557d8-1ee1-473a-947a-2d23ad1a2441 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:36.320160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f31557d8-1ee1-473a-947a-2d23ad1a2441), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.320160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Security group rule updated ['0fc767b6-e687-4858-b561-63b49bb5c366'] Oct 09 01:02:36.320160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Resource SecurityGroupRule deleted: f92f4a7d-a3b8-4fce-b7b6-b4820dcd22ae {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:36.320160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f92f4a7d-a3b8-4fce-b7b6-b4820dcd22ae), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:36.320562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b1748c28-9f79-4bfa-8835-85b78d869f4a admin admin] Security group rule updated ['0fc767b6-e687-4858-b561-63b49bb5c366'] Oct 09 01:02:36.842037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:441 started Oct 09 01:02:36.844476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=165000000,duration_sec=899,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:36.845054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:36.845443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:441 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:38.843284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:442 started Oct 09 01:02:38.845616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=167000000,duration_sec=901,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:38.846194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:38.846540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:442 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:02:40.843788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:443 started Oct 09 01:02:40.846126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efdc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=167000000,duration_sec=903,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:40.846758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:40.847109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:443 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:42.845053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:444 started Oct 09 01:02:42.848335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=168000000,duration_sec=905,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:42.848902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:42.849254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:444 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:44.845777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:445 started Oct 09 01:02:44.848113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efe0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=169000000,duration_sec=907,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:44.848681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:44.849038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:445 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:02:45.619961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:45Z,description='Default security group',id=4ce0a359-3695-49ac-b0b5-84863448e99b,is_default=True,name='default',project_id='e78172ea7902488bb2ab00394644f064',revision_number=1,rules=[SecurityGroupRule(8d2d3f27-1997-4b91-be7e-842313197812),SecurityGroupRule(9f1ab8c7-310d-4135-929c-9e906d48e892),SecurityGroupRule(bd67405c-1e1a-4a12-84e8-a4c88db19d74),SecurityGroupRule(da5008e5-2da6-4fc0-a870-4fb3cd55fadd)],shared=False,stateful=True,updated_at=2022-10-09T01:02:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:45.620446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (4ce0a359-3695-49ac-b0b5-84863448e99b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.621105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:45Z,description=,direction='egress',ethertype='IPv4',id=8d2d3f27-1997-4b91-be7e-842313197812,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e78172ea7902488bb2ab00394644f064',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4ce0a359-3695-49ac-b0b5-84863448e99b,updated_at=2022-10-09T01:02:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:45.621465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8d2d3f27-1997-4b91-be7e-842313197812), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.621790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Security group rule updated ['4ce0a359-3695-49ac-b0b5-84863448e99b'] Oct 09 01:02:45.622472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:45Z,description=,direction='ingress',ethertype='IPv4',id=9f1ab8c7-310d-4135-929c-9e906d48e892,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e78172ea7902488bb2ab00394644f064',protocol=,remote_address_group_id=,remote_group_id=4ce0a359-3695-49ac-b0b5-84863448e99b,remote_ip_prefix=,revision_number=0,security_group_id=4ce0a359-3695-49ac-b0b5-84863448e99b,updated_at=2022-10-09T01:02:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:45.622823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9f1ab8c7-310d-4135-929c-9e906d48e892), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.623144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Security group rule updated ['4ce0a359-3695-49ac-b0b5-84863448e99b'] Oct 09 01:02:45.624190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:45Z,description=,direction='ingress',ethertype='IPv6',id=bd67405c-1e1a-4a12-84e8-a4c88db19d74,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e78172ea7902488bb2ab00394644f064',protocol=,remote_address_group_id=,remote_group_id=4ce0a359-3695-49ac-b0b5-84863448e99b,remote_ip_prefix=,revision_number=0,security_group_id=4ce0a359-3695-49ac-b0b5-84863448e99b,updated_at=2022-10-09T01:02:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:45.624190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (bd67405c-1e1a-4a12-84e8-a4c88db19d74), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.624498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Security group rule updated ['4ce0a359-3695-49ac-b0b5-84863448e99b'] Oct 09 01:02:45.625115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:45Z,description=,direction='egress',ethertype='IPv6',id=da5008e5-2da6-4fc0-a870-4fb3cd55fadd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e78172ea7902488bb2ab00394644f064',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4ce0a359-3695-49ac-b0b5-84863448e99b,updated_at=2022-10-09T01:02:45Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:45.625461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (da5008e5-2da6-4fc0-a870-4fb3cd55fadd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.625807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6adf3301-f3a2-43a4-99f8-fc348803ff42 admin admin] Security group rule updated ['4ce0a359-3695-49ac-b0b5-84863448e99b'] Oct 09 01:02:45.849182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Resource SecurityGroup deleted: 4ce0a359-3695-49ac-b0b5-84863448e99b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:45.849864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (4ce0a359-3695-49ac-b0b5-84863448e99b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.849968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4ce0a359-3695-49ac-b0b5-84863448e99b',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:45.862584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4ce0a359-3695-49ac-b0b5-84863448e99b',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:45.862940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Resource SecurityGroupRule deleted: 8d2d3f27-1997-4b91-be7e-842313197812 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:45.863296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8d2d3f27-1997-4b91-be7e-842313197812), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.863651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Security group rule updated ['4ce0a359-3695-49ac-b0b5-84863448e99b'] Oct 09 01:02:45.864034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Resource SecurityGroupRule deleted: 9f1ab8c7-310d-4135-929c-9e906d48e892 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:45.864369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9f1ab8c7-310d-4135-929c-9e906d48e892), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.864679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Security group rule updated ['4ce0a359-3695-49ac-b0b5-84863448e99b'] Oct 09 01:02:45.865040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Resource SecurityGroupRule deleted: bd67405c-1e1a-4a12-84e8-a4c88db19d74 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:45.865369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (bd67405c-1e1a-4a12-84e8-a4c88db19d74), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.865675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Security group rule updated ['4ce0a359-3695-49ac-b0b5-84863448e99b'] Oct 09 01:02:45.866153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Resource SecurityGroupRule deleted: da5008e5-2da6-4fc0-a870-4fb3cd55fadd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:45.866374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (da5008e5-2da6-4fc0-a870-4fb3cd55fadd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:45.866681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edba1258-2437-4e8e-a75b-879122ab10d7 admin admin] Security group rule updated ['4ce0a359-3695-49ac-b0b5-84863448e99b'] Oct 09 01:02:46.847174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:446 started Oct 09 01:02:46.850285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efe2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=171000000,duration_sec=909,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:46.850842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:46.851194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:446 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:48.333042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:48Z,description='Default security group',id=17e11d1c-79b6-48a3-8eba-bdc0545c30ae,is_default=True,name='default',project_id='fd5c9701cead4c6aa7f6701847268df2',revision_number=1,rules=[SecurityGroupRule(011afc6b-db75-415b-8de6-a789f25fcefa),SecurityGroupRule(3f09524d-575c-4518-b42b-5bfa5fa668b7),SecurityGroupRule(deb6eb9e-277d-4d41-a10b-376f8110bf00),SecurityGroupRule(f2e2abf7-24d2-4fae-aadd-25d48dc662d8)],shared=False,stateful=True,updated_at=2022-10-09T01:02:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:48.333664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (17e11d1c-79b6-48a3-8eba-bdc0545c30ae), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.334705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:48Z,description=,direction='ingress',ethertype='IPv4',id=011afc6b-db75-415b-8de6-a789f25fcefa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fd5c9701cead4c6aa7f6701847268df2',protocol=,remote_address_group_id=,remote_group_id=17e11d1c-79b6-48a3-8eba-bdc0545c30ae,remote_ip_prefix=,revision_number=0,security_group_id=17e11d1c-79b6-48a3-8eba-bdc0545c30ae,updated_at=2022-10-09T01:02:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:48.335210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (011afc6b-db75-415b-8de6-a789f25fcefa), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.335753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Security group rule updated ['17e11d1c-79b6-48a3-8eba-bdc0545c30ae'] Oct 09 01:02:48.336884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:48Z,description=,direction='egress',ethertype='IPv4',id=3f09524d-575c-4518-b42b-5bfa5fa668b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fd5c9701cead4c6aa7f6701847268df2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=17e11d1c-79b6-48a3-8eba-bdc0545c30ae,updated_at=2022-10-09T01:02:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:48.337435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3f09524d-575c-4518-b42b-5bfa5fa668b7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.337943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Security group rule updated ['17e11d1c-79b6-48a3-8eba-bdc0545c30ae'] Oct 09 01:02:48.339049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:48Z,description=,direction='ingress',ethertype='IPv6',id=deb6eb9e-277d-4d41-a10b-376f8110bf00,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fd5c9701cead4c6aa7f6701847268df2',protocol=,remote_address_group_id=,remote_group_id=17e11d1c-79b6-48a3-8eba-bdc0545c30ae,remote_ip_prefix=,revision_number=0,security_group_id=17e11d1c-79b6-48a3-8eba-bdc0545c30ae,updated_at=2022-10-09T01:02:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:48.339605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (deb6eb9e-277d-4d41-a10b-376f8110bf00), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.340587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Security group rule updated ['17e11d1c-79b6-48a3-8eba-bdc0545c30ae'] Oct 09 01:02:48.341234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:48Z,description=,direction='egress',ethertype='IPv6',id=f2e2abf7-24d2-4fae-aadd-25d48dc662d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fd5c9701cead4c6aa7f6701847268df2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=17e11d1c-79b6-48a3-8eba-bdc0545c30ae,updated_at=2022-10-09T01:02:48Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:48.341785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (f2e2abf7-24d2-4fae-aadd-25d48dc662d8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.342295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-977502b7-f263-4907-a0ad-b16efc4fc3d5 admin admin] Security group rule updated ['17e11d1c-79b6-48a3-8eba-bdc0545c30ae'] Oct 09 01:02:48.459842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Resource SecurityGroup deleted: 17e11d1c-79b6-48a3-8eba-bdc0545c30ae {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:48.460275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (17e11d1c-79b6-48a3-8eba-bdc0545c30ae), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.460720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('17e11d1c-79b6-48a3-8eba-bdc0545c30ae',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:48.473838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('17e11d1c-79b6-48a3-8eba-bdc0545c30ae',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:48.474467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Resource SecurityGroupRule deleted: 011afc6b-db75-415b-8de6-a789f25fcefa {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:48.474962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (011afc6b-db75-415b-8de6-a789f25fcefa), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.475363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Security group rule updated ['17e11d1c-79b6-48a3-8eba-bdc0545c30ae'] Oct 09 01:02:48.475855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Resource SecurityGroupRule deleted: 3f09524d-575c-4518-b42b-5bfa5fa668b7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:48.476267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3f09524d-575c-4518-b42b-5bfa5fa668b7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.476718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Security group rule updated ['17e11d1c-79b6-48a3-8eba-bdc0545c30ae'] Oct 09 01:02:48.477196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Resource SecurityGroupRule deleted: deb6eb9e-277d-4d41-a10b-376f8110bf00 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:48.477578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (deb6eb9e-277d-4d41-a10b-376f8110bf00), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.477962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Security group rule updated ['17e11d1c-79b6-48a3-8eba-bdc0545c30ae'] Oct 09 01:02:48.478325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Resource SecurityGroupRule deleted: f2e2abf7-24d2-4fae-aadd-25d48dc662d8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:48.478667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f2e2abf7-24d2-4fae-aadd-25d48dc662d8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:48.479032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1419ab60-5fb7-43ed-9daf-601eb3d8c4f1 admin admin] Security group rule updated ['17e11d1c-79b6-48a3-8eba-bdc0545c30ae'] Oct 09 01:02:48.847984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:447 started Oct 09 01:02:48.851293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efe4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=172000000,duration_sec=911,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:48.851934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:48.852413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:447 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:02:50.848509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:448 started Oct 09 01:02:50.851272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efe6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=172000000,duration_sec=913,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:50.851916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:50.852331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:448 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:02:52.655970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:02:52Z,description='Default security group',id=8b87c768-c25e-4c05-834f-276f6a839a3a,is_default=True,name='default',project_id='a5885c2f35074c2ab0e51257836943b4',revision_number=1,rules=[SecurityGroupRule(528a5fec-5c8a-4749-b433-b49dced5435e),SecurityGroupRule(c27132c5-51b3-4af8-b769-244b3718cb47),SecurityGroupRule(e54bca80-2b5d-42e2-919f-8dc283be02cf),SecurityGroupRule(ed5b42fc-be41-463f-a199-0fe98cab5f4b)],shared=False,stateful=True,updated_at=2022-10-09T01:02:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:52.656592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (8b87c768-c25e-4c05-834f-276f6a839a3a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.656965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:52Z,description=,direction='ingress',ethertype='IPv4',id=528a5fec-5c8a-4749-b433-b49dced5435e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5885c2f35074c2ab0e51257836943b4',protocol=,remote_address_group_id=,remote_group_id=8b87c768-c25e-4c05-834f-276f6a839a3a,remote_ip_prefix=,revision_number=0,security_group_id=8b87c768-c25e-4c05-834f-276f6a839a3a,updated_at=2022-10-09T01:02:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:52.657306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (528a5fec-5c8a-4749-b433-b49dced5435e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.657634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Security group rule updated ['8b87c768-c25e-4c05-834f-276f6a839a3a'] Oct 09 01:02:52.658292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:52Z,description=,direction='egress',ethertype='IPv6',id=c27132c5-51b3-4af8-b769-244b3718cb47,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5885c2f35074c2ab0e51257836943b4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8b87c768-c25e-4c05-834f-276f6a839a3a,updated_at=2022-10-09T01:02:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:52.658643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (c27132c5-51b3-4af8-b769-244b3718cb47), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.658958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Security group rule updated ['8b87c768-c25e-4c05-834f-276f6a839a3a'] Oct 09 01:02:52.660218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:52Z,description=,direction='ingress',ethertype='IPv6',id=e54bca80-2b5d-42e2-919f-8dc283be02cf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5885c2f35074c2ab0e51257836943b4',protocol=,remote_address_group_id=,remote_group_id=8b87c768-c25e-4c05-834f-276f6a839a3a,remote_ip_prefix=,revision_number=0,security_group_id=8b87c768-c25e-4c05-834f-276f6a839a3a,updated_at=2022-10-09T01:02:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:52.660556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e54bca80-2b5d-42e2-919f-8dc283be02cf), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.660983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Security group rule updated ['8b87c768-c25e-4c05-834f-276f6a839a3a'] Oct 09 01:02:52.661631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:02:52Z,description=,direction='egress',ethertype='IPv4',id=ed5b42fc-be41-463f-a199-0fe98cab5f4b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5885c2f35074c2ab0e51257836943b4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8b87c768-c25e-4c05-834f-276f6a839a3a,updated_at=2022-10-09T01:02:52Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:02:52.661978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ed5b42fc-be41-463f-a199-0fe98cab5f4b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.662301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c6d08262-ffac-4243-aa64-6b29794dd616 admin admin] Security group rule updated ['8b87c768-c25e-4c05-834f-276f6a839a3a'] Oct 09 01:02:52.789977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Resource SecurityGroup deleted: 8b87c768-c25e-4c05-834f-276f6a839a3a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:52.790528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (8b87c768-c25e-4c05-834f-276f6a839a3a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.790992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8b87c768-c25e-4c05-834f-276f6a839a3a',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:02:52.807512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8b87c768-c25e-4c05-834f-276f6a839a3a',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:02:52.807990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Resource SecurityGroupRule deleted: 528a5fec-5c8a-4749-b433-b49dced5435e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:52.808357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (528a5fec-5c8a-4749-b433-b49dced5435e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.808688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Security group rule updated ['8b87c768-c25e-4c05-834f-276f6a839a3a'] Oct 09 01:02:52.809070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Resource SecurityGroupRule deleted: c27132c5-51b3-4af8-b769-244b3718cb47 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:52.809461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c27132c5-51b3-4af8-b769-244b3718cb47), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.809782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Security group rule updated ['8b87c768-c25e-4c05-834f-276f6a839a3a'] Oct 09 01:02:52.810144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Resource SecurityGroupRule deleted: e54bca80-2b5d-42e2-919f-8dc283be02cf {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:52.810478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e54bca80-2b5d-42e2-919f-8dc283be02cf), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.810788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Security group rule updated ['8b87c768-c25e-4c05-834f-276f6a839a3a'] Oct 09 01:02:52.811149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Resource SecurityGroupRule deleted: ed5b42fc-be41-463f-a199-0fe98cab5f4b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:02:52.811480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ed5b42fc-be41-463f-a199-0fe98cab5f4b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:52.811812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6baf65e4-18a4-4ef7-b780-cc93ffa3ff8a admin admin] Security group rule updated ['8b87c768-c25e-4c05-834f-276f6a839a3a'] Oct 09 01:02:52.849374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:449 started Oct 09 01:02:52.854085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efe8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=173000000,duration_sec=915,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:52.855356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:52.856014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:449 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 01:02:54.345321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:02:54.345986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:54.851926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:450 started Oct 09 01:02:54.855265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=175000000,duration_sec=917,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:54.855872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:54.856212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:450 - starting polling. Elapsed:0.006 Oct 09 01:02:54.858480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:54.861250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:450 - port information retrieved. Elapsed:0.011 Oct 09 01:02:54.861743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:450 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 01:02:56.365438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:02:56.366153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:56.851425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:451 started Oct 09 01:02:56.855689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=175000000,duration_sec=919,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:56.856319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:56.856687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:451 - starting polling. Elapsed:0.006 Oct 09 01:02:56.858951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:02:56.864716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:451 - port information retrieved. Elapsed:0.013 Oct 09 01:02:56.865343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:451 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 09 01:02:58.852245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:452 started Oct 09 01:02:58.854712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363efee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=176000000,duration_sec=921,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:02:58.855277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:02:58.855658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:452 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:03:00.852990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:453 started Oct 09 01:03:00.856212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eff0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=177000000,duration_sec=923,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:00.856776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:00.857127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:453 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:03:02.858415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:454 started Oct 09 01:03:02.860984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eff2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=182000000,duration_sec=925,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:02.861551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:02.861899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:454 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:03:04.854782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:455 started Oct 09 01:03:04.856990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eff4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=178000000,duration_sec=927,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:04.857540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:04.857886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:455 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:03:06.855380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:456 started Oct 09 01:03:06.857907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eff6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=179000000,duration_sec=929,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:06.858497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:06.858845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:456 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:03:08.348223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:08.348927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:08.856261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:457 started Oct 09 01:03:08.859054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363eff8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=180000000,duration_sec=931,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:08.859731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:08.860066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:457 - starting polling. Elapsed:0.004 Oct 09 01:03:08.862068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:08.865321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:457 - port information retrieved. Elapsed:0.009 Oct 09 01:03:08.865707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:457 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:03:10.856864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:458 started Oct 09 01:03:10.863208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363effa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=180000000,duration_sec=933,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:10.863790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:10.864675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:458 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 01:03:12.857970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:459 started Oct 09 01:03:12.860349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363effc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=181000000,duration_sec=935,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:12.860904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:12.861250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:459 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:03:14.858717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:460 started Oct 09 01:03:14.861476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363effe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=182000000,duration_sec=937,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:14.862232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:14.862588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:460 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:03:16.859575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:461 started Oct 09 01:03:16.862611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f000,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=184000000,duration_sec=939,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:16.863960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:16.864330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:461 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:03:18.860336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:462 started Oct 09 01:03:18.865944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f002,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=184000000,duration_sec=941,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:18.866851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:18.867399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:462 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 01:03:20.861869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:463 started Oct 09 01:03:20.865585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f004,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=185000000,duration_sec=943,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:20.866393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:20.867159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:463 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:03:22.862954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:464 started Oct 09 01:03:22.872992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f006,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=188000000,duration_sec=945,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:22.874095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:22.874755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:464 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 09 01:03:24.865322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:465 started Oct 09 01:03:24.868188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f008,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=189000000,duration_sec=947,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:24.868836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:24.869248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:465 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:03:25.687026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:03:25Z,description='Default security group',id=1c8ecf63-798c-49cb-873e-84f8e5c3fdcc,is_default=True,name='default',project_id='d1cc477f1f0948158585b2f499b16b14',revision_number=1,rules=[SecurityGroupRule(61580143-2db6-47c3-b0c7-c1014b7817f9),SecurityGroupRule(6f62df03-9a55-432a-b392-c9bcb56f9fa2),SecurityGroupRule(b0eec788-4d4a-4052-b4c0-231edfb3fec8),SecurityGroupRule(b19f9fd0-a1db-42b1-b63c-c41e6822c0a7)],shared=False,stateful=True,updated_at=2022-10-09T01:03:25Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:25.687486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (1c8ecf63-798c-49cb-873e-84f8e5c3fdcc), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.688132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:25Z,description=,direction='ingress',ethertype='IPv4',id=61580143-2db6-47c3-b0c7-c1014b7817f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d1cc477f1f0948158585b2f499b16b14',protocol=,remote_address_group_id=,remote_group_id=1c8ecf63-798c-49cb-873e-84f8e5c3fdcc,remote_ip_prefix=,revision_number=0,security_group_id=1c8ecf63-798c-49cb-873e-84f8e5c3fdcc,updated_at=2022-10-09T01:03:25Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:25.688495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (61580143-2db6-47c3-b0c7-c1014b7817f9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.688829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Security group rule updated ['1c8ecf63-798c-49cb-873e-84f8e5c3fdcc'] Oct 09 01:03:25.689489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:25Z,description=,direction='egress',ethertype='IPv4',id=6f62df03-9a55-432a-b392-c9bcb56f9fa2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d1cc477f1f0948158585b2f499b16b14',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1c8ecf63-798c-49cb-873e-84f8e5c3fdcc,updated_at=2022-10-09T01:03:25Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:25.689838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6f62df03-9a55-432a-b392-c9bcb56f9fa2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.690251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Security group rule updated ['1c8ecf63-798c-49cb-873e-84f8e5c3fdcc'] Oct 09 01:03:25.690904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:25Z,description=,direction='ingress',ethertype='IPv6',id=b0eec788-4d4a-4052-b4c0-231edfb3fec8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d1cc477f1f0948158585b2f499b16b14',protocol=,remote_address_group_id=,remote_group_id=1c8ecf63-798c-49cb-873e-84f8e5c3fdcc,remote_ip_prefix=,revision_number=0,security_group_id=1c8ecf63-798c-49cb-873e-84f8e5c3fdcc,updated_at=2022-10-09T01:03:25Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:25.691251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b0eec788-4d4a-4052-b4c0-231edfb3fec8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.691575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Security group rule updated ['1c8ecf63-798c-49cb-873e-84f8e5c3fdcc'] Oct 09 01:03:25.692237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:25Z,description=,direction='egress',ethertype='IPv6',id=b19f9fd0-a1db-42b1-b63c-c41e6822c0a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d1cc477f1f0948158585b2f499b16b14',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1c8ecf63-798c-49cb-873e-84f8e5c3fdcc,updated_at=2022-10-09T01:03:25Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:25.692585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b19f9fd0-a1db-42b1-b63c-c41e6822c0a7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.692906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fa1fd6db-90a6-44b5-a120-a19c25df5675 admin admin] Security group rule updated ['1c8ecf63-798c-49cb-873e-84f8e5c3fdcc'] Oct 09 01:03:25.805623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Resource SecurityGroup deleted: 1c8ecf63-798c-49cb-873e-84f8e5c3fdcc {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:03:25.805913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (1c8ecf63-798c-49cb-873e-84f8e5c3fdcc), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.806428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1c8ecf63-798c-49cb-873e-84f8e5c3fdcc',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:03:25.819849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1c8ecf63-798c-49cb-873e-84f8e5c3fdcc',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:03:25.820464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Resource SecurityGroupRule deleted: 61580143-2db6-47c3-b0c7-c1014b7817f9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:03:25.820888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (61580143-2db6-47c3-b0c7-c1014b7817f9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.821280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Security group rule updated ['1c8ecf63-798c-49cb-873e-84f8e5c3fdcc'] Oct 09 01:03:25.821724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Resource SecurityGroupRule deleted: 6f62df03-9a55-432a-b392-c9bcb56f9fa2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:03:25.822148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6f62df03-9a55-432a-b392-c9bcb56f9fa2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.822468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Security group rule updated ['1c8ecf63-798c-49cb-873e-84f8e5c3fdcc'] Oct 09 01:03:25.822831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Resource SecurityGroupRule deleted: b0eec788-4d4a-4052-b4c0-231edfb3fec8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:03:25.823170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b0eec788-4d4a-4052-b4c0-231edfb3fec8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.823482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Security group rule updated ['1c8ecf63-798c-49cb-873e-84f8e5c3fdcc'] Oct 09 01:03:25.823871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Resource SecurityGroupRule deleted: b19f9fd0-a1db-42b1-b63c-c41e6822c0a7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:03:25.824206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b19f9fd0-a1db-42b1-b63c-c41e6822c0a7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:25.824514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-a98cd9c0-cef2-45c8-a116-189be216f8c1 admin admin] Security group rule updated ['1c8ecf63-798c-49cb-873e-84f8e5c3fdcc'] Oct 09 01:03:26.723198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:03:26Z,description='Default security group',id=0795ffbb-6daf-4bba-a742-e224a73d68c6,is_default=True,name='default',project_id='f37de57a22a246f0935f85392898dd42',revision_number=1,rules=[SecurityGroupRule(15e95934-298a-490b-a2ae-31288aa83a4a),SecurityGroupRule(1d1612a6-5cd0-4080-b7bd-91e114aa4cbc),SecurityGroupRule(9585c10e-8b97-4a7e-bcc3-0bc475ba7dee),SecurityGroupRule(e5b7a36c-8e9d-4d56-955e-a88091f5b954)],shared=False,stateful=True,updated_at=2022-10-09T01:03:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:26.724445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (0795ffbb-6daf-4bba-a742-e224a73d68c6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:26.724776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:26Z,description=,direction='ingress',ethertype='IPv6',id=15e95934-298a-490b-a2ae-31288aa83a4a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol=,remote_address_group_id=,remote_group_id=0795ffbb-6daf-4bba-a742-e224a73d68c6,remote_ip_prefix=,revision_number=0,security_group_id=0795ffbb-6daf-4bba-a742-e224a73d68c6,updated_at=2022-10-09T01:03:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:26.725161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (15e95934-298a-490b-a2ae-31288aa83a4a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:26.725474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Security group rule updated ['0795ffbb-6daf-4bba-a742-e224a73d68c6'] Oct 09 01:03:26.726152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:26Z,description=,direction='ingress',ethertype='IPv4',id=1d1612a6-5cd0-4080-b7bd-91e114aa4cbc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol=,remote_address_group_id=,remote_group_id=0795ffbb-6daf-4bba-a742-e224a73d68c6,remote_ip_prefix=,revision_number=0,security_group_id=0795ffbb-6daf-4bba-a742-e224a73d68c6,updated_at=2022-10-09T01:03:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:26.726509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1d1612a6-5cd0-4080-b7bd-91e114aa4cbc), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:26.726838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Security group rule updated ['0795ffbb-6daf-4bba-a742-e224a73d68c6'] Oct 09 01:03:26.727490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:26Z,description=,direction='egress',ethertype='IPv6',id=9585c10e-8b97-4a7e-bcc3-0bc475ba7dee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0795ffbb-6daf-4bba-a742-e224a73d68c6,updated_at=2022-10-09T01:03:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:26.727892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9585c10e-8b97-4a7e-bcc3-0bc475ba7dee), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:26.728220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Security group rule updated ['0795ffbb-6daf-4bba-a742-e224a73d68c6'] Oct 09 01:03:26.728872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:26Z,description=,direction='egress',ethertype='IPv4',id=e5b7a36c-8e9d-4d56-955e-a88091f5b954,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0795ffbb-6daf-4bba-a742-e224a73d68c6,updated_at=2022-10-09T01:03:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:26.729332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (e5b7a36c-8e9d-4d56-955e-a88091f5b954), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:26.729664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Security group rule updated ['0795ffbb-6daf-4bba-a742-e224a73d68c6'] Oct 09 01:03:26.862215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T01:03:26Z,description='',dns_domain=None,id=6785419e-1d43-419a-bc35-ef45112ab443,mtu=1500,name='tempest-TestMinimumBasicScenario-1509093388-network',project_id='f37de57a22a246f0935f85392898dd42',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(6785419e-1d43-419a-bc35-ef45112ab443),segments=[NetworkSegment(a9f7e284-0af3-4e7c-8362-b09e14e08087)],shared=False,status='ACTIVE',updated_at=2022-10-09T01:03:26Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:26.862678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (6785419e-1d43-419a-bc35-ef45112ab443), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:26.870689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:466 started Oct 09 01:03:26.873818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f00a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=194000000,duration_sec=949,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:26.874454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:26.874891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:466 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-55294128-f6dc-4bcc-8538-e5ab2661c9da admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6785419e-1d43-419a-bc35-ef45112ab443 with segmentation id not found. Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 01:03:26.932655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 01:03:26.933835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 01:03:26.933835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 01:03:26.933835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 01:03:26.933835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6785419e-1d43-419a-bc35-ef45112ab443 with segmentation id not found. Oct 09 01:03:26.933835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 01:03:27.109526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4bc1e24e-fe38-418c-b90f-898a4ec8aa65 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(fa71823b-ac33-40f4-8d79-6af4877a0d66)],cidr=172.20.0.0/28,created_at=2022-10-09T01:03:26Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=98b6e2f7-a736-4245-b55d-f9e6c9acd558,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-1509093388-subnet',network_id=6785419e-1d43-419a-bc35-ef45112ab443,project_id='f37de57a22a246f0935f85392898dd42',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T01:03:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:27.109900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4bc1e24e-fe38-418c-b90f-898a4ec8aa65 admin admin] Publish callbacks [] for Subnet (98b6e2f7-a736-4245-b55d-f9e6c9acd558), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:27.613701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c8680df2-1b0f-443b-bd59-cc87ec7f3579 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:27Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6785419e-1d43-419a-bc35-ef45112ab443',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=58897c2b-173b-4d6c-a17a-700b101c1987,mac_address=fa:16:3e:a9:af:38,name='',network_id=6785419e-1d43-419a-bc35-ef45112ab443,numa_affinity_policy=,project_id='f37de57a22a246f0935f85392898dd42',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(58897c2b-173b-4d6c-a17a-700b101c1987),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:03:27Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:27.614236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c8680df2-1b0f-443b-bd59-cc87ec7f3579 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (58897c2b-173b-4d6c-a17a-700b101c1987), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:27.837532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c8680df2-1b0f-443b-bd59-cc87ec7f3579 None None] Resource Port 58897c2b-173b-4d6c-a17a-700b101c1987 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=58897c2b-173b-4d6c-a17a-700b101c1987,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=58897c2b-173b-4d6c-a17a-700b101c1987,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=58897c2b-173b-4d6c-a17a-700b101c1987,segment=NetworkSegment(a9f7e284-0af3-4e7c-8362-b09e14e08087),segment_id=a9f7e284-0af3-4e7c-8362-b09e14e08087)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:27.838639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c8680df2-1b0f-443b-bd59-cc87ec7f3579 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (58897c2b-173b-4d6c-a17a-700b101c1987), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:27.927405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8e5e5887-cbba-4720-a8fe-0dd86942bfd1","insert","tap58897c2b-17",["set",[]],["map",[["attached-mac","fa:16:3e:a9:af:38"],["iface-id","58897c2b-173b-4d6c-a17a-700b101c1987"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:27.962853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8e5e5887-cbba-4720-a8fe-0dd86942bfd1","old",null,["set",[]],null],["","new","tap58897c2b-17",27,["map",[["attached-mac","fa:16:3e:a9:af:38"],["iface-id","58897c2b-173b-4d6c-a17a-700b101c1987"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:28.036695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-37bb1d80-781d-4dbd-9fdf-f04182e022d7 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:27Z,data_plane_status=None,description='',device_id='2b74eea3-225c-425e-890b-fcc6a5af7adb',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f1fb537b-7bbd-40c4-9fa9-2d496f13cb55,mac_address=fa:16:3e:c1:f8:e4,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f1fb537b-7bbd-40c4-9fa9-2d496f13cb55),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:03:27Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:28.037374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-37bb1d80-781d-4dbd-9fdf-f04182e022d7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f1fb537b-7bbd-40c4-9fa9-2d496f13cb55), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:28.872381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:467 started Oct 09 01:03:28.875464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f00c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=196000000,duration_sec=951,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:28.876076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:28.876680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:467 - starting polling. Elapsed:0.005 Oct 09 01:03:28.878825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:28.882258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:467 - port information retrieved. Elapsed:0.010 Oct 09 01:03:28.882592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': {'58897c2b-173b-4d6c-a17a-700b101c1987'}, 'removed': set(), 'updated': {'58897c2b-173b-4d6c-a17a-700b101c1987'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:28.883186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '58897c2b-173b-4d6c-a17a-700b101c1987', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6785419e-1d43-419a-bc35-ef45112ab443', 'network_id': '6785419e-1d43-419a-bc35-ef45112ab443', 'port_id': '58897c2b-173b-4d6c-a17a-700b101c1987', 'mac_address': 'fa:16:3e:a9:af:38', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 671, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '98b6e2f7-a736-4245-b55d-f9e6c9acd558', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:28.885904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 58897c2b-173b-4d6c-a17a-700b101c1987 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:28.886247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 58897c2b-173b-4d6c-a17a-700b101c1987 updated. Details: {'device': '58897c2b-173b-4d6c-a17a-700b101c1987', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6785419e-1d43-419a-bc35-ef45112ab443', 'network_id': '6785419e-1d43-419a-bc35-ef45112ab443', 'port_id': '58897c2b-173b-4d6c-a17a-700b101c1987', 'mac_address': 'fa:16:3e:a9:af:38', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 671, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '98b6e2f7-a736-4245-b55d-f9e6c9acd558', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 01:03:28.886821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 11 as local vlan for net-id=6785419e-1d43-419a-bc35-ef45112ab443, seg-id=671 Oct 09 01:03:28.891737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da183d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4767), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:28.895297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363f00e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4107)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4767}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:28.897123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap58897c2b-17, col_values=(('tag', 11),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:28.898110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap58897c2b-17, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:28.898888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap58897c2b-17, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:28.908373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap58897c2b-17, col_values=(('other_config', {'net_uuid': '6785419e-1d43-419a-bc35-ef45112ab443', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '671'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:28.918229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f010,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:28.918937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:467 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.036 Oct 09 01:03:28.919477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:03:28.920003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'58897c2b-173b-4d6c-a17a-700b101c1987'} Oct 09 01:03:28.921328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:28.921807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:28.926012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:28.978383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[2870666e-b77e-4bf2-bbc1-e4381d72da91]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:28.978922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:467 - agent port security group processed in 0.096 Oct 09 01:03:28.979681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 58897c2b-173b-4d6c-a17a-700b101c1987 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:29.527177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bd101151-9c01-45f1-b8fe-6f61b985d440 None None] Resource Port 58897c2b-173b-4d6c-a17a-700b101c1987 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:29.528225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bd101151-9c01-45f1-b8fe-6f61b985d440 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (58897c2b-173b-4d6c-a17a-700b101c1987), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:29.615066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['58897c2b-173b-4d6c-a17a-700b101c1987'] and devices down [] completed. Oct 09 01:03:29.616260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:467 - ports processed. Elapsed:0.744 Oct 09 01:03:29.616842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:467 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.745 Oct 09 01:03:29.721615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8a052e7a-5757-4ec8-a6ce-bf34cebb4d42 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:29Z,data_plane_status=None,description='',device_id='2b74eea3-225c-425e-890b-fcc6a5af7adb',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=14973d20-f33b-4361-a1f8-ebeb1bf4ca82,mac_address=fa:16:3e:c3:53:16,name='',network_id=6785419e-1d43-419a-bc35-ef45112ab443,numa_affinity_policy=,project_id='f37de57a22a246f0935f85392898dd42',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(14973d20-f33b-4361-a1f8-ebeb1bf4ca82),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:03:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:29.722229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8a052e7a-5757-4ec8-a6ce-bf34cebb4d42 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (14973d20-f33b-4361-a1f8-ebeb1bf4ca82), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:30.043991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6ade5137-a73d-4d81-8265-5e124f3f9e4a None None] Resource Port f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=f1fb537b-7bbd-40c4-9fa9-2d496f13cb55,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f1fb537b-7bbd-40c4-9fa9-2d496f13cb55,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:30.045506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6ade5137-a73d-4d81-8265-5e124f3f9e4a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f1fb537b-7bbd-40c4-9fa9-2d496f13cb55), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:30.211892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8a052e7a-5757-4ec8-a6ce-bf34cebb4d42 admin admin] Received resource Port update without any changes: 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 01:03:30.289765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6ade5137-a73d-4d81-8265-5e124f3f9e4a None None] Resource Port f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f1fb537b-7bbd-40c4-9fa9-2d496f13cb55,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f1fb537b-7bbd-40c4-9fa9-2d496f13cb55,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f1fb537b-7bbd-40c4-9fa9-2d496f13cb55,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:30.290587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6ade5137-a73d-4d81-8265-5e124f3f9e4a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f1fb537b-7bbd-40c4-9fa9-2d496f13cb55), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:30.740189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7c711e8e-0120-4f6d-a182-8f6562695f6c","insert","qr-14973d20-f3",["set",[]],["map",[["attached-mac","fa:16:3e:c3:53:16"],["iface-id","14973d20-f33b-4361-a1f8-ebeb1bf4ca82"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:30.750543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7c711e8e-0120-4f6d-a182-8f6562695f6c","old",null,["set",[]],null],["","new","qr-14973d20-f3",28,["map",[["attached-mac","fa:16:3e:c3:53:16"],["iface-id","14973d20-f33b-4361-a1f8-ebeb1bf4ca82"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:30.873874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:468 started Oct 09 01:03:30.876798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f012,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=197000000,duration_sec=953,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:30.877651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:30.878521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:468 - starting polling. Elapsed:0.005 Oct 09 01:03:30.881909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:30.885645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:468 - port information retrieved. Elapsed:0.012 Oct 09 01:03:30.888186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'e117ae0c-3834-457d-833e-82227f33c129', '694ef31e-6f15-4593-9990-eb27b05a49e8', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '4c3a97ee-facb-4248-818b-3d6676479188', '6fc925b8-cc04-47c9-908d-92ab057747b2', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': {'14973d20-f33b-4361-a1f8-ebeb1bf4ca82'}, 'removed': set(), 'updated': {'14973d20-f33b-4361-a1f8-ebeb1bf4ca82', '58897c2b-173b-4d6c-a17a-700b101c1987'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:30.888879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:29Z,data_plane_status=None,description='',device_id='2b74eea3-225c-425e-890b-fcc6a5af7adb',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=14973d20-f33b-4361-a1f8-ebeb1bf4ca82,mac_address=fa:16:3e:c3:53:16,name='',network_id=6785419e-1d43-419a-bc35-ef45112ab443,numa_affinity_policy=,project_id='f37de57a22a246f0935f85392898dd42',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(14973d20-f33b-4361-a1f8-ebeb1bf4ca82),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:03:29Z) is not bound. Oct 09 01:03:30.890192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '58897c2b-173b-4d6c-a17a-700b101c1987', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6785419e-1d43-419a-bc35-ef45112ab443', 'network_id': '6785419e-1d43-419a-bc35-ef45112ab443', 'port_id': '58897c2b-173b-4d6c-a17a-700b101c1987', 'mac_address': 'fa:16:3e:a9:af:38', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 671, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '98b6e2f7-a736-4245-b55d-f9e6c9acd558', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:30.893374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:30.893731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 not defined on plugin or binding failed Oct 09 01:03:30.894272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 58897c2b-173b-4d6c-a17a-700b101c1987 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:30.894664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 58897c2b-173b-4d6c-a17a-700b101c1987 updated. Details: {'device': '58897c2b-173b-4d6c-a17a-700b101c1987', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6785419e-1d43-419a-bc35-ef45112ab443', 'network_id': '6785419e-1d43-419a-bc35-ef45112ab443', 'port_id': '58897c2b-173b-4d6c-a17a-700b101c1987', 'mac_address': 'fa:16:3e:a9:af:38', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 671, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '98b6e2f7-a736-4245-b55d-f9e6c9acd558', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 09 01:03:30.898040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap58897c2b-17, col_values=(('tag', 11),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:30.898592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap58897c2b-17, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:30.899394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap58897c2b-17, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:30.900235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:30.902091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap58897c2b-17, col_values=(('other_config', {'net_uuid': '6785419e-1d43-419a-bc35-ef45112ab443', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '671', 'tag': '11'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:30.902786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:30.905088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f014,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:30.905438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:468 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.017 Oct 09 01:03:30.905790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:03:30.906413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'14973d20-f33b-4361-a1f8-ebeb1bf4ca82'} Oct 09 01:03:30.907955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:30.908507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:30.913647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:03:30.913946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:03:30.915208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:30.915738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:30.920111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:30.966473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[740577d2-1781-4d02-ad35-ee35357984f5]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:30.968206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:468 - agent port security group processed in 0.080 Oct 09 01:03:30.968978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 58897c2b-173b-4d6c-a17a-700b101c1987 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:31.144609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['58897c2b-173b-4d6c-a17a-700b101c1987'] and devices down [] completed. Oct 09 01:03:31.145254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:468 - ports processed. Elapsed:0.271 Oct 09 01:03:31.146299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:468 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.272 Oct 09 01:03:31.267528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["47befcd7-f080-43c1-b818-07bdd4c2b20b","insert","qg-f1fb537b-7b",["set",[]],["map",[["attached-mac","fa:16:3e:c1:f8:e4"],["iface-id","f1fb537b-7bbd-40c4-9fa9-2d496f13cb55"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:31.283050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["47befcd7-f080-43c1-b818-07bdd4c2b20b","old",null,["set",[]],null],["","new","qg-f1fb537b-7b",29,["map",[["attached-mac","fa:16:3e:c1:f8:e4"],["iface-id","f1fb537b-7bbd-40c4-9fa9-2d496f13cb55"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:31.315504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:03:31Z,description='Default security group',id=2edb6e4f-1dea-408d-aced-d7192ae453bb,is_default=True,name='default',project_id='7e5245a0acb348b8a6764ca11ac5b746',revision_number=1,rules=[SecurityGroupRule(16ba3a12-d2bc-4fb7-a4b7-0eeffa022a55),SecurityGroupRule(410f8fb3-4d23-44d7-868d-fed01d4119b4),SecurityGroupRule(56ccec15-f819-42d4-9aca-c49aef1c54ca),SecurityGroupRule(7a606972-8d08-4dde-a842-49b398dd111b)],shared=False,stateful=True,updated_at=2022-10-09T01:03:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:31.316318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (2edb6e4f-1dea-408d-aced-d7192ae453bb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:31.317863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:31Z,description=,direction='egress',ethertype='IPv6',id=16ba3a12-d2bc-4fb7-a4b7-0eeffa022a55,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e5245a0acb348b8a6764ca11ac5b746',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2edb6e4f-1dea-408d-aced-d7192ae453bb,updated_at=2022-10-09T01:03:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:31.318527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (16ba3a12-d2bc-4fb7-a4b7-0eeffa022a55), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:31.319046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Security group rule updated ['2edb6e4f-1dea-408d-aced-d7192ae453bb'] Oct 09 01:03:31.319962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:31Z,description=,direction='ingress',ethertype='IPv4',id=410f8fb3-4d23-44d7-868d-fed01d4119b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e5245a0acb348b8a6764ca11ac5b746',protocol=,remote_address_group_id=,remote_group_id=2edb6e4f-1dea-408d-aced-d7192ae453bb,remote_ip_prefix=,revision_number=0,security_group_id=2edb6e4f-1dea-408d-aced-d7192ae453bb,updated_at=2022-10-09T01:03:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:31.321466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (410f8fb3-4d23-44d7-868d-fed01d4119b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:31.321806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Security group rule updated ['2edb6e4f-1dea-408d-aced-d7192ae453bb'] Oct 09 01:03:31.322487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:31Z,description=,direction='ingress',ethertype='IPv6',id=56ccec15-f819-42d4-9aca-c49aef1c54ca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e5245a0acb348b8a6764ca11ac5b746',protocol=,remote_address_group_id=,remote_group_id=2edb6e4f-1dea-408d-aced-d7192ae453bb,remote_ip_prefix=,revision_number=0,security_group_id=2edb6e4f-1dea-408d-aced-d7192ae453bb,updated_at=2022-10-09T01:03:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:31.322845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (56ccec15-f819-42d4-9aca-c49aef1c54ca), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:31.323171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Security group rule updated ['2edb6e4f-1dea-408d-aced-d7192ae453bb'] Oct 09 01:03:31.323876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:03:31Z,description=,direction='egress',ethertype='IPv4',id=7a606972-8d08-4dde-a842-49b398dd111b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e5245a0acb348b8a6764ca11ac5b746',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2edb6e4f-1dea-408d-aced-d7192ae453bb,updated_at=2022-10-09T01:03:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:31.324227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7a606972-8d08-4dde-a842-49b398dd111b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:31.324552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Security group rule updated ['2edb6e4f-1dea-408d-aced-d7192ae453bb'] Oct 09 01:03:31.457294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T01:03:31Z,description='',dns_domain=None,id=eb19f52f-afcc-41bb-9895-b089b3330962,mtu=1500,name='tempest-TestMinimumBasicScenario-11689001-network',project_id='7e5245a0acb348b8a6764ca11ac5b746',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(eb19f52f-afcc-41bb-9895-b089b3330962),segments=[NetworkSegment(e86bd807-902c-4194-ad31-3ebb8453cf88)],shared=False,status='ACTIVE',updated_at=2022-10-09T01:03:31Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:31.458702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (eb19f52f-afcc-41bb-9895-b089b3330962), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-0cb11015-e7ad-4291-9783-0e281c7acc67 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network eb19f52f-afcc-41bb-9895-b089b3330962 with segmentation id not found. Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 01:03:31.538235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 01:03:31.539333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 01:03:31.539333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 01:03:31.539333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 01:03:31.539333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network eb19f52f-afcc-41bb-9895-b089b3330962 with segmentation id not found. Oct 09 01:03:31.539333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 01:03:31.725582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fbecc259-bd6b-4527-87dc-a95c100f3957 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(72340070-f0a5-4889-92fb-44260c5fdff5)],cidr=172.20.0.0/28,created_at=2022-10-09T01:03:31Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-11689001-subnet',network_id=eb19f52f-afcc-41bb-9895-b089b3330962,project_id='7e5245a0acb348b8a6764ca11ac5b746',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T01:03:31Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:31.725872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fbecc259-bd6b-4527-87dc-a95c100f3957 admin admin] Publish callbacks [] for Subnet (f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:32.308280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-05195388-0c81-4629-8442-89759fe90712 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:31Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-eb19f52f-afcc-41bb-9895-b089b3330962',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0323fb7d-0982-4e2d-8701-9118321c427f,mac_address=fa:16:3e:0b:8c:7d,name='',network_id=eb19f52f-afcc-41bb-9895-b089b3330962,numa_affinity_policy=,project_id='7e5245a0acb348b8a6764ca11ac5b746',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0323fb7d-0982-4e2d-8701-9118321c427f),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:03:32Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:32.309637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-05195388-0c81-4629-8442-89759fe90712 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0323fb7d-0982-4e2d-8701-9118321c427f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:32.880314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:469 started Oct 09 01:03:32.883083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f016,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=204000000,duration_sec=955,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:32.883745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:32.884205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:469 - starting polling. Elapsed:0.005 Oct 09 01:03:32.886658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:32.889991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:469 - port information retrieved. Elapsed:0.010 Oct 09 01:03:32.893613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'e117ae0c-3834-457d-833e-82227f33c129', '694ef31e-6f15-4593-9990-eb27b05a49e8', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '4c3a97ee-facb-4248-818b-3d6676479188', '6fc925b8-cc04-47c9-908d-92ab057747b2', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': {'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:32.894388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'device_id': '2b74eea3-225c-425e-890b-fcc6a5af7adb', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'mac_address': 'fa:16:3e:c1:f8:e4', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.88'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:32.902505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:32.904106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 updated. Details: {'device': 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'device_id': '2b74eea3-225c-425e-890b-fcc6a5af7adb', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'mac_address': 'fa:16:3e:c1:f8:e4', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.88'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:03:32.905513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f1fb537b-7b, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:32.908060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-f1fb537b-7b, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:32.908833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-f1fb537b-7b, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:32.925975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f1fb537b-7b, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:32.941584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f018,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:32.942757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:469 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.048 Oct 09 01:03:32.943214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:03:32.943621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55'} Oct 09 01:03:32.945016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:32.946284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:32.963320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:32.969789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-05195388-0c81-4629-8442-89759fe90712 None None] Resource Port 0323fb7d-0982-4e2d-8701-9118321c427f updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0323fb7d-0982-4e2d-8701-9118321c427f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0323fb7d-0982-4e2d-8701-9118321c427f,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0323fb7d-0982-4e2d-8701-9118321c427f,segment=NetworkSegment(e86bd807-902c-4194-ad31-3ebb8453cf88),segment_id=e86bd807-902c-4194-ad31-3ebb8453cf88)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:32.974457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-05195388-0c81-4629-8442-89759fe90712 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0323fb7d-0982-4e2d-8701-9118321c427f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:33.019610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:33.020348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:33.032250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d68ff6-691d-4d82-bbbf-56d37163f349]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:33.033119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:469 - agent port security group processed in 0.139 Oct 09 01:03:33.034106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:33.115459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c1490ad2-24c9-420f-9976-956e73905b2a","insert","tap0323fb7d-09",["set",[]],["map",[["attached-mac","fa:16:3e:0b:8c:7d"],["iface-id","0323fb7d-0982-4e2d-8701-9118321c427f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:33.120314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a415fc77-3884-43ca-a9b0-096dfa34acf6 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:32Z,data_plane_status=None,description='',device_id='2b5bb0d1-7958-4e18-ab8a-19304d40eb96',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=be87fabf-44c3-4811-bd4f-74e4a5079a6d,mac_address=fa:16:3e:e0:e5:9e,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(be87fabf-44c3-4811-bd4f-74e4a5079a6d),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:03:32Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:33.121158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a415fc77-3884-43ca-a9b0-096dfa34acf6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (be87fabf-44c3-4811-bd4f-74e4a5079a6d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:33.138662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c1490ad2-24c9-420f-9976-956e73905b2a","old",null,["set",[]],null],["","new","tap0323fb7d-09",30,["map",[["attached-mac","fa:16:3e:0b:8c:7d"],["iface-id","0323fb7d-0982-4e2d-8701-9118321c427f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:33.386767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['f1fb537b-7bbd-40c4-9fa9-2d496f13cb55'] and devices down [] completed. Oct 09 01:03:33.387362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:469 - ports processed. Elapsed:0.508 Oct 09 01:03:33.387470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:469 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.508 Oct 09 01:03:33.500411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f1fb537b-7bbd-40c4-9fa9-2d496f13cb55,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f1fb537b-7bbd-40c4-9fa9-2d496f13cb55,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:33.500869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f1fb537b-7bbd-40c4-9fa9-2d496f13cb55), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:33.989840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7dd2bff9-562a-40e0-803c-fe3c7b0036c2 None None] Resource Port 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=14973d20-f33b-4361-a1f8-ebeb1bf4ca82,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=14973d20-f33b-4361-a1f8-ebeb1bf4ca82,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:33.990348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7dd2bff9-562a-40e0-803c-fe3c7b0036c2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (14973d20-f33b-4361-a1f8-ebeb1bf4ca82), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:34.208871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7dd2bff9-562a-40e0-803c-fe3c7b0036c2 None None] Resource Port 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=14973d20-f33b-4361-a1f8-ebeb1bf4ca82,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=14973d20-f33b-4361-a1f8-ebeb1bf4ca82,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=14973d20-f33b-4361-a1f8-ebeb1bf4ca82,segment=NetworkSegment(a9f7e284-0af3-4e7c-8362-b09e14e08087),segment_id=a9f7e284-0af3-4e7c-8362-b09e14e08087)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:34.209505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7dd2bff9-562a-40e0-803c-fe3c7b0036c2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (14973d20-f33b-4361-a1f8-ebeb1bf4ca82), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:34.880607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:470 started Oct 09 01:03:34.884145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f01a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=205000000,duration_sec=957,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:34.884876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:34.885369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:470 - starting polling. Elapsed:0.005 Oct 09 01:03:34.889309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:34.892721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:470 - port information retrieved. Elapsed:0.012 Oct 09 01:03:34.893060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'e117ae0c-3834-457d-833e-82227f33c129', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': {'0323fb7d-0982-4e2d-8701-9118321c427f'}, 'removed': set(), 'updated': {'0323fb7d-0982-4e2d-8701-9118321c427f', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:34.893628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '0323fb7d-0982-4e2d-8701-9118321c427f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-eb19f52f-afcc-41bb-9895-b089b3330962', 'network_id': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'port_id': '0323fb7d-0982-4e2d-8701-9118321c427f', 'mac_address': 'fa:16:3e:0b:8c:7d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 676, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:34.894085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'device_id': '2b74eea3-225c-425e-890b-fcc6a5af7adb', 'network_id': '6785419e-1d43-419a-bc35-ef45112ab443', 'port_id': '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'mac_address': 'fa:16:3e:c3:53:16', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 671, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '98b6e2f7-a736-4245-b55d-f9e6c9acd558', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:34.894559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'device_id': '2b74eea3-225c-425e-890b-fcc6a5af7adb', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'mac_address': 'fa:16:3e:c1:f8:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.88'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:34.908780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 0323fb7d-0982-4e2d-8701-9118321c427f {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:34.909140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 0323fb7d-0982-4e2d-8701-9118321c427f updated. Details: {'device': '0323fb7d-0982-4e2d-8701-9118321c427f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-eb19f52f-afcc-41bb-9895-b089b3330962', 'network_id': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'port_id': '0323fb7d-0982-4e2d-8701-9118321c427f', 'mac_address': 'fa:16:3e:0b:8c:7d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 676, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 01:03:34.909477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 12 as local vlan for net-id=eb19f52f-afcc-41bb-9895-b089b3330962, seg-id=676 Oct 09 01:03:34.927229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da183f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4772), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:34.941001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363f01c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4108)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4772}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:34.942469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap0323fb7d-09, col_values=(('tag', 12),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:34.943272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap0323fb7d-09, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:34.944224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap0323fb7d-09, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:34.960411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap0323fb7d-09, col_values=(('other_config', {'net_uuid': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '676'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:34.976238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f01e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:34.977555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:34.978101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 updated. Details: {'device': '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'device_id': '2b74eea3-225c-425e-890b-fcc6a5af7adb', 'network_id': '6785419e-1d43-419a-bc35-ef45112ab443', 'port_id': '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'mac_address': 'fa:16:3e:c3:53:16', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 671, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '98b6e2f7-a736-4245-b55d-f9e6c9acd558', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 09 01:03:34.979434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-14973d20-f3, col_values=(('tag', 11),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:34.980164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-14973d20-f3, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:34.980851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-14973d20-f3, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:34.991292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-14973d20-f3, col_values=(('other_config', {'net_uuid': '6785419e-1d43-419a-bc35-ef45112ab443', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '671'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:35.008170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f020,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:35.009009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:35.009519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 updated. Details: {'device': 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'device_id': '2b74eea3-225c-425e-890b-fcc6a5af7adb', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'mac_address': 'fa:16:3e:c1:f8:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.88'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:03:35.011483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f1fb537b-7b, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:35.012231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-f1fb537b-7b, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:35.013257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-f1fb537b-7b, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:35.014850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:35.016949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f1fb537b-7b, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:35.018066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:35.030633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f022,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:35.042507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:470 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.138 Oct 09 01:03:35.043903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:03:35.044416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'0323fb7d-0982-4e2d-8701-9118321c427f'} Oct 09 01:03:35.046974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:35.048993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:35.063579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:35.147440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[7173f13a-4321-41bf-b8b0-35f106e3ca10]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:35.148291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:03:35.148659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:03:35.150429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:35.150713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:35.158414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:35.211151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2bb1d113-29cd-4cb3-80ce-209f5fbbb8ec None None] Resource Port 0323fb7d-0982-4e2d-8701-9118321c427f updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:35.211908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2bb1d113-29cd-4cb3-80ce-209f5fbbb8ec None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (0323fb7d-0982-4e2d-8701-9118321c427f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:35.241901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b3375-a745-4e56-bd83-dc1a430ce48a]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:35.242526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:470 - agent port security group processed in 0.349 Oct 09 01:03:35.243945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 0323fb7d-0982-4e2d-8701-9118321c427f to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:35.244420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:35.244980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:35.443460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:35.444624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:35.471954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e3147f8c-7963-406c-8ecf-6c005d9a1a84 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:34Z,data_plane_status=None,description='',device_id='2b5bb0d1-7958-4e18-ab8a-19304d40eb96',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e4bdc121-2f27-45a0-bc01-9927bf7604d8,mac_address=fa:16:3e:6e:b7:1d,name='',network_id=eb19f52f-afcc-41bb-9895-b089b3330962,numa_affinity_policy=,project_id='7e5245a0acb348b8a6764ca11ac5b746',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e4bdc121-2f27-45a0-bc01-9927bf7604d8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:03:34Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:35.472674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e3147f8c-7963-406c-8ecf-6c005d9a1a84 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e4bdc121-2f27-45a0-bc01-9927bf7604d8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:36.061559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-53bee198-e741-49e3-aa29-f4ca601ff8c8 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:35Z,data_plane_status=None,description='',device_id='3e8b0e22-9d18-412f-97b9-bf5e750c9dcb',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=07d4f0c5-1202-4554-b832-08bb967ca163,mac_address=fa:16:3e:ed:e4:9b,name='',network_id=51f66c80-6e94-4ac9-ad00-6dd9246260d1,numa_affinity_policy=,project_id='28bc82345ea24b929b66fbcded2b97b7',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(07d4f0c5-1202-4554-b832-08bb967ca163),security_group_ids=set([45da6575-619b-423b-bc04-7f831c564029]),status='DOWN',updated_at=2022-10-09T01:03:35Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:36.063324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-53bee198-e741-49e3-aa29-f4ca601ff8c8 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (07d4f0c5-1202-4554-b832-08bb967ca163), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:36.064104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-53bee198-e741-49e3-aa29-f4ca601ff8c8 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group member updated {'45da6575-619b-423b-bc04-7f831c564029'} Oct 09 01:03:36.091154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e3147f8c-7963-406c-8ecf-6c005d9a1a84 admin admin] Received resource Port update without any changes: e4bdc121-2f27-45a0-bc01-9927bf7604d8 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 01:03:36.425851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2d97f37b-734f-4099-ad03-6e07f5efc58b None None] Resource Port be87fabf-44c3-4811-bd4f-74e4a5079a6d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=be87fabf-44c3-4811-bd4f-74e4a5079a6d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=be87fabf-44c3-4811-bd4f-74e4a5079a6d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:36.426374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2d97f37b-734f-4099-ad03-6e07f5efc58b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (be87fabf-44c3-4811-bd4f-74e4a5079a6d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:36.844282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2d97f37b-734f-4099-ad03-6e07f5efc58b None None] Resource Port be87fabf-44c3-4811-bd4f-74e4a5079a6d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=be87fabf-44c3-4811-bd4f-74e4a5079a6d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=be87fabf-44c3-4811-bd4f-74e4a5079a6d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=be87fabf-44c3-4811-bd4f-74e4a5079a6d,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:36.844949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2d97f37b-734f-4099-ad03-6e07f5efc58b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (be87fabf-44c3-4811-bd4f-74e4a5079a6d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:36.993806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:36.994445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (14973d20-f33b-4361-a1f8-ebeb1bf4ca82), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:37.009484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-65fe3884-e452-447f-9c70-d4760ea3e4c2 service neutron] Resource Port 07d4f0c5-1202-4554-b832-08bb967ca163 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=07d4f0c5-1202-4554-b832-08bb967ca163,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=07d4f0c5-1202-4554-b832-08bb967ca163,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:37.014387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-65fe3884-e452-447f-9c70-d4760ea3e4c2 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (07d4f0c5-1202-4554-b832-08bb967ca163), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:37.167380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['0323fb7d-0982-4e2d-8701-9118321c427f', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55'] and devices down [] completed. Oct 09 01:03:37.168501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:470 - ports processed. Elapsed:2.288 Oct 09 01:03:37.169068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:470 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:2.289 Oct 09 01:03:37.170348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Loop iteration exceeded interval (2 vs. 2.2885916233062744)! {{(pid=107274) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 09 01:03:37.170536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:471 started Oct 09 01:03:37.173810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f024,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=494000000,duration_sec=959,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:37.174950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:37.175308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:471 - starting polling. Elapsed:0.005 Oct 09 01:03:37.178512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:37.182069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:471 - port information retrieved. Elapsed:0.011 Oct 09 01:03:37.182595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'e117ae0c-3834-457d-833e-82227f33c129', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'0323fb7d-0982-4e2d-8701-9118321c427f', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:37.184252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '0323fb7d-0982-4e2d-8701-9118321c427f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-eb19f52f-afcc-41bb-9895-b089b3330962', 'network_id': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'port_id': '0323fb7d-0982-4e2d-8701-9118321c427f', 'mac_address': 'fa:16:3e:0b:8c:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 676, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:37.186226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'device_id': '2b74eea3-225c-425e-890b-fcc6a5af7adb', 'network_id': '6785419e-1d43-419a-bc35-ef45112ab443', 'port_id': '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'mac_address': 'fa:16:3e:c3:53:16', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 671, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '98b6e2f7-a736-4245-b55d-f9e6c9acd558', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:37.189602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 0323fb7d-0982-4e2d-8701-9118321c427f {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:37.190097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 0323fb7d-0982-4e2d-8701-9118321c427f updated. Details: {'device': '0323fb7d-0982-4e2d-8701-9118321c427f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-eb19f52f-afcc-41bb-9895-b089b3330962', 'network_id': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'port_id': '0323fb7d-0982-4e2d-8701-9118321c427f', 'mac_address': 'fa:16:3e:0b:8c:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 676, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Oct 09 01:03:37.191584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap0323fb7d-09, col_values=(('tag', 12),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:37.192235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap0323fb7d-09, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:37.192949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap0323fb7d-09, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:37.193645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:37.195287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap0323fb7d-09, col_values=(('other_config', {'net_uuid': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '676', 'tag': '12'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:37.196289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:37.199870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f026,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:37.200406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:37.200977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 updated. Details: {'device': '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'device_id': '2b74eea3-225c-425e-890b-fcc6a5af7adb', 'network_id': '6785419e-1d43-419a-bc35-ef45112ab443', 'port_id': '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'mac_address': 'fa:16:3e:c3:53:16', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 671, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '98b6e2f7-a736-4245-b55d-f9e6c9acd558', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 09 01:03:37.202350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-14973d20-f3, col_values=(('tag', 11),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:37.202929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-14973d20-f3, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:37.203483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-14973d20-f3, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:37.204101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:37.205632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-14973d20-f3, col_values=(('other_config', {'net_uuid': '6785419e-1d43-419a-bc35-ef45112ab443', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '671', 'tag': '11'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:37.206374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:37.209546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f028,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:37.210427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:471 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.027 Oct 09 01:03:37.211324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:03:37.211907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:03:37.215999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:37.216632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:37.229098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:37.314185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d3dc1-56b2-4e4d-a58d-2c7b8fe458f0]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:37.315076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:471 - agent port security group processed in 0.132 Oct 09 01:03:37.316014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 0323fb7d-0982-4e2d-8701-9118321c427f to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:37.316377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:37.483274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-65fe3884-e452-447f-9c70-d4760ea3e4c2 service neutron] Resource Port 07d4f0c5-1202-4554-b832-08bb967ca163 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=07d4f0c5-1202-4554-b832-08bb967ca163,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=07d4f0c5-1202-4554-b832-08bb967ca163,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=07d4f0c5-1202-4554-b832-08bb967ca163,segment=NetworkSegment(9512762e-780c-464c-a567-4995173eb1a6),segment_id=9512762e-780c-464c-a567-4995173eb1a6)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:37.483693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-65fe3884-e452-447f-9c70-d4760ea3e4c2 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (07d4f0c5-1202-4554-b832-08bb967ca163), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:37.541109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d7f7ab11-14fd-4559-acc3-5ab64d7cbebd","insert","qr-e4bdc121-2f",["set",[]],["map",[["attached-mac","fa:16:3e:6e:b7:1d"],["iface-id","e4bdc121-2f27-45a0-bc01-9927bf7604d8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:37.557569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d7f7ab11-14fd-4559-acc3-5ab64d7cbebd","old",null,["set",[]],null],["","new","qr-e4bdc121-2f",31,["map",[["attached-mac","fa:16:3e:6e:b7:1d"],["iface-id","e4bdc121-2f27-45a0-bc01-9927bf7604d8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:37.827951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['0323fb7d-0982-4e2d-8701-9118321c427f', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82'] and devices down [] completed. Oct 09 01:03:37.828273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:471 - ports processed. Elapsed:0.658 Oct 09 01:03:37.828609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:471 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.658 Oct 09 01:03:38.138142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a9ded6a1-08c7-463b-8d73-8e6c214f237e","insert","qg-be87fabf-44",["set",[]],["map",[["attached-mac","fa:16:3e:e0:e5:9e"],["iface-id","be87fabf-44c3-4811-bd4f-74e4a5079a6d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:38.161490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a9ded6a1-08c7-463b-8d73-8e6c214f237e","old",null,["set",[]],null],["","new","qg-be87fabf-44",32,["map",[["attached-mac","fa:16:3e:e0:e5:9e"],["iface-id","be87fabf-44c3-4811-bd4f-74e4a5079a6d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:03:39.171519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:472 started Oct 09 01:03:39.174148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f02a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=495000000,duration_sec=961,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:39.175046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:39.175785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:472 - starting polling. Elapsed:0.004 Oct 09 01:03:39.178757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:39.182889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:472 - port information retrieved. Elapsed:0.012 Oct 09 01:03:39.183421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'e117ae0c-3834-457d-833e-82227f33c129', 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': {'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'be87fabf-44c3-4811-bd4f-74e4a5079a6d'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:39.184581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:34Z,data_plane_status=None,description='',device_id='2b5bb0d1-7958-4e18-ab8a-19304d40eb96',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e4bdc121-2f27-45a0-bc01-9927bf7604d8,mac_address=fa:16:3e:6e:b7:1d,name='',network_id=eb19f52f-afcc-41bb-9895-b089b3330962,numa_affinity_policy=,project_id='7e5245a0acb348b8a6764ca11ac5b746',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(e4bdc121-2f27-45a0-bc01-9927bf7604d8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:03:35Z) is not bound. Oct 09 01:03:39.185294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'device_id': '2b5bb0d1-7958-4e18-ab8a-19304d40eb96', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'mac_address': 'fa:16:3e:e0:e5:9e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.132'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:39.189019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e4bdc121-2f27-45a0-bc01-9927bf7604d8 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:39.189489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Device e4bdc121-2f27-45a0-bc01-9927bf7604d8 not defined on plugin or binding failed Oct 09 01:03:39.190300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: be87fabf-44c3-4811-bd4f-74e4a5079a6d {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:39.190780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port be87fabf-44c3-4811-bd4f-74e4a5079a6d updated. Details: {'device': 'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'device_id': '2b5bb0d1-7958-4e18-ab8a-19304d40eb96', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'mac_address': 'fa:16:3e:e0:e5:9e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.132'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:03:39.194123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-be87fabf-44, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:39.194514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-be87fabf-44, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:39.195061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-be87fabf-44, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:39.202643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-be87fabf-44, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:39.228904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f02c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:39.231063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:472 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.047 Oct 09 01:03:39.231641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 2 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:03:39.232127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'be87fabf-44c3-4811-bd4f-74e4a5079a6d'} Oct 09 01:03:39.233908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:39.234368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:39.239222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:39.280016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c40aa3-7a12-4da6-b42f-0f569bdd3c38]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:39.281017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:472 - agent port security group processed in 0.097 Oct 09 01:03:39.281916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for be87fabf-44c3-4811-bd4f-74e4a5079a6d to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:39.494498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['be87fabf-44c3-4811-bd4f-74e4a5079a6d'] and devices down [] completed. Oct 09 01:03:39.495037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:472 - ports processed. Elapsed:0.323 Oct 09 01:03:39.495650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:472 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.324 Oct 09 01:03:39.558296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port be87fabf-44c3-4811-bd4f-74e4a5079a6d updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=be87fabf-44c3-4811-bd4f-74e4a5079a6d,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=be87fabf-44c3-4811-bd4f-74e4a5079a6d,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:39.559503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (be87fabf-44c3-4811-bd4f-74e4a5079a6d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:41.172222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:473 started Oct 09 01:03:41.175481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f02e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=496000000,duration_sec=963,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:41.176132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:41.176474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:473 - starting polling. Elapsed:0.004 Oct 09 01:03:41.178989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:41.182815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:473 - port information retrieved. Elapsed:0.011 Oct 09 01:03:41.183417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'e117ae0c-3834-457d-833e-82227f33c129', 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'be87fabf-44c3-4811-bd4f-74e4a5079a6d'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:41.184943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'device_id': '2b5bb0d1-7958-4e18-ab8a-19304d40eb96', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'mac_address': 'fa:16:3e:e0:e5:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.132'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:41.188500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: be87fabf-44c3-4811-bd4f-74e4a5079a6d {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:41.188819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port be87fabf-44c3-4811-bd4f-74e4a5079a6d updated. Details: {'device': 'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'device_id': '2b5bb0d1-7958-4e18-ab8a-19304d40eb96', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'mac_address': 'fa:16:3e:e0:e5:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.132'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:03:41.189847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-be87fabf-44, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:41.190416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-be87fabf-44, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:41.190814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-be87fabf-44, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:41.191270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:41.192608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-be87fabf-44, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:41.193505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:41.196802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f030,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:41.197149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:473 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.012 Oct 09 01:03:41.197497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:03:41.197782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:03:41.198901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:41.199176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:41.203401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:41.257672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac952a-5da7-413e-b5e8-b29b7633c130]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:41.258291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:473 - agent port security group processed in 0.074 Oct 09 01:03:41.259905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for be87fabf-44c3-4811-bd4f-74e4a5079a6d to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:41.416678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['be87fabf-44c3-4811-bd4f-74e4a5079a6d'] and devices down [] completed. Oct 09 01:03:41.417277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:473 - ports processed. Elapsed:0.245 Oct 09 01:03:41.417868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:473 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.246 Oct 09 01:03:42.049445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5a655eef-cc5a-4931-affe-c58c602674b4 None None] Resource Port e4bdc121-2f27-45a0-bc01-9927bf7604d8 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=e4bdc121-2f27-45a0-bc01-9927bf7604d8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e4bdc121-2f27-45a0-bc01-9927bf7604d8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:42.050411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5a655eef-cc5a-4931-affe-c58c602674b4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e4bdc121-2f27-45a0-bc01-9927bf7604d8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:42.296030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5a655eef-cc5a-4931-affe-c58c602674b4 None None] Resource Port e4bdc121-2f27-45a0-bc01-9927bf7604d8 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e4bdc121-2f27-45a0-bc01-9927bf7604d8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e4bdc121-2f27-45a0-bc01-9927bf7604d8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e4bdc121-2f27-45a0-bc01-9927bf7604d8,segment=NetworkSegment(e86bd807-902c-4194-ad31-3ebb8453cf88),segment_id=e86bd807-902c-4194-ad31-3ebb8453cf88)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:42.296727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5a655eef-cc5a-4931-affe-c58c602674b4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e4bdc121-2f27-45a0-bc01-9927bf7604d8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:43.173020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:474 started Oct 09 01:03:43.175725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f032,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=497000000,duration_sec=965,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:43.176323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:43.176651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:474 - starting polling. Elapsed:0.004 Oct 09 01:03:43.179434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:43.183049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:474 - port information retrieved. Elapsed:0.010 Oct 09 01:03:43.186150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'e117ae0c-3834-457d-833e-82227f33c129', 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'e4bdc121-2f27-45a0-bc01-9927bf7604d8'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:43.188256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'device_id': '2b5bb0d1-7958-4e18-ab8a-19304d40eb96', 'network_id': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'port_id': 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'mac_address': 'fa:16:3e:6e:b7:1d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 676, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:43.195584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e4bdc121-2f27-45a0-bc01-9927bf7604d8 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:43.195934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e4bdc121-2f27-45a0-bc01-9927bf7604d8 updated. Details: {'device': 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'device_id': '2b5bb0d1-7958-4e18-ab8a-19304d40eb96', 'network_id': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'port_id': 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'mac_address': 'fa:16:3e:6e:b7:1d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 676, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Oct 09 01:03:43.196925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4bdc121-2f, col_values=(('tag', 12),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:43.197347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-e4bdc121-2f, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:43.197772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-e4bdc121-2f, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:43.209060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4bdc121-2f, col_values=(('other_config', {'net_uuid': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '676'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:43.221881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f034,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:43.222696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:474 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.036 Oct 09 01:03:43.223335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:03:43.224021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:03:43.225368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:43.225723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:43.230489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:43.273256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[04720fc2-e6c9-40e3-9f05-e9d1ba8014c6]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:43.274122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:474 - agent port security group processed in 0.087 Oct 09 01:03:43.277160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for e4bdc121-2f27-45a0-bc01-9927bf7604d8 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:43.613073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['e4bdc121-2f27-45a0-bc01-9927bf7604d8'] and devices down [] completed. Oct 09 01:03:43.613830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:474 - ports processed. Elapsed:0.441 Oct 09 01:03:43.614024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:474 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.441 Oct 09 01:03:43.669685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port e4bdc121-2f27-45a0-bc01-9927bf7604d8 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:43.670292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e4bdc121-2f27-45a0-bc01-9927bf7604d8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:45.174370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:475 started Oct 09 01:03:45.177629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f036,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=498000000,duration_sec=967,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:45.178198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:45.178537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:475 - starting polling. Elapsed:0.004 Oct 09 01:03:45.181932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:45.185599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:475 - port information retrieved. Elapsed:0.011 Oct 09 01:03:45.186157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'e117ae0c-3834-457d-833e-82227f33c129', 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', '14973d20-f33b-4361-a1f8-ebeb1bf4ca82', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': set(), 'updated': {'e4bdc121-2f27-45a0-bc01-9927bf7604d8'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:03:45.186926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'device_id': '2b5bb0d1-7958-4e18-ab8a-19304d40eb96', 'network_id': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'port_id': 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'mac_address': 'fa:16:3e:6e:b7:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 676, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:03:45.190893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: e4bdc121-2f27-45a0-bc01-9927bf7604d8 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:03:45.191413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e4bdc121-2f27-45a0-bc01-9927bf7604d8 updated. Details: {'device': 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'device_id': '2b5bb0d1-7958-4e18-ab8a-19304d40eb96', 'network_id': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'port_id': 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'mac_address': 'fa:16:3e:6e:b7:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 676, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Oct 09 01:03:45.192527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4bdc121-2f, col_values=(('tag', 12),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:45.192950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-e4bdc121-2f, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:45.193348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-e4bdc121-2f, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:45.193787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:45.194541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4bdc121-2f, col_values=(('other_config', {'net_uuid': 'eb19f52f-afcc-41bb-9895-b089b3330962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '676', 'tag': '12'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:03:45.195202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:03:45.199252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f038,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:45.199948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:475 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.013 Oct 09 01:03:45.200469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:03:45.200761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:03:45.202010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:03:45.202322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:03:45.206559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:03:45.247747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c25c3-266b-485d-89c5-1808d78468e9]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:03:45.248364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:475 - agent port security group processed in 0.062 Oct 09 01:03:45.249497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for e4bdc121-2f27-45a0-bc01-9927bf7604d8 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:03:45.385139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['e4bdc121-2f27-45a0-bc01-9927bf7604d8'] and devices down [] completed. Oct 09 01:03:45.385459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:475 - ports processed. Elapsed:0.211 Oct 09 01:03:45.385797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:475 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.212 Oct 09 01:03:47.175203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:476 started Oct 09 01:03:47.177620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f03a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=499000000,duration_sec=969,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:47.178190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:47.178573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:476 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:03:48.577458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 07d4f0c5-1202-4554-b832-08bb967ca163 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:48.578063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (07d4f0c5-1202-4554-b832-08bb967ca163), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:49.176825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:477 started Oct 09 01:03:49.179898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f03c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=501000000,duration_sec=971,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:49.180707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:49.181227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:477 - starting polling. Elapsed:0.005 Oct 09 01:03:49.184114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:49.192483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:477 - port information retrieved. Elapsed:0.013 Oct 09 01:03:49.192965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:477 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 09 01:03:49.828722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-41871fcf-443a-4ddf-a339-838e1a727efc tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:03:49Z,data_plane_status=None,description='',device_id='aa737c98-4038-4554-80d9-17b8cbd242c9',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ebfdac77-d547-424a-bd77-91436ba7750c,mac_address=fa:16:3e:99:c7:c0,name='',network_id=6785419e-1d43-419a-bc35-ef45112ab443,numa_affinity_policy=,project_id='f37de57a22a246f0935f85392898dd42',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ebfdac77-d547-424a-bd77-91436ba7750c),security_group_ids=set([0795ffbb-6daf-4bba-a742-e224a73d68c6]),status='DOWN',updated_at=2022-10-09T01:03:49Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:03:49.829404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-41871fcf-443a-4ddf-a339-838e1a727efc tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ebfdac77-d547-424a-bd77-91436ba7750c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:49.829557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-41871fcf-443a-4ddf-a339-838e1a727efc tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group member updated {'0795ffbb-6daf-4bba-a742-e224a73d68c6'} Oct 09 01:03:50.590679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 07d4f0c5-1202-4554-b832-08bb967ca163 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:50.591374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (07d4f0c5-1202-4554-b832-08bb967ca163), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:51.177353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:478 started Oct 09 01:03:51.179808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f03e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=501000000,duration_sec=973,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:51.180447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:51.180782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:478 - starting polling. Elapsed:0.004 Oct 09 01:03:51.183461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:51.186997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:478 - port information retrieved. Elapsed:0.010 Oct 09 01:03:51.187334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:478 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:03:53.178852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:479 started Oct 09 01:03:53.183394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f040,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=504000000,duration_sec=975,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:53.184254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:53.184606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:479 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 01:03:55.179445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:480 started Oct 09 01:03:55.184436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f042,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=503000000,duration_sec=977,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:55.185687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:55.186333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:480 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 01:03:57.180445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:481 started Oct 09 01:03:57.182943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f044,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=504000000,duration_sec=979,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:57.183671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:57.184122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:481 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:03:58.440079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ef29d0a2-dc52-4c9b-a3fd-65a221e72442 service neutron] Resource Port ebfdac77-d547-424a-bd77-91436ba7750c updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=ebfdac77-d547-424a-bd77-91436ba7750c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=ebfdac77-d547-424a-bd77-91436ba7750c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:58.441977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ef29d0a2-dc52-4c9b-a3fd-65a221e72442 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ebfdac77-d547-424a-bd77-91436ba7750c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:58.757749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ef29d0a2-dc52-4c9b-a3fd-65a221e72442 service neutron] Resource Port ebfdac77-d547-424a-bd77-91436ba7750c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ebfdac77-d547-424a-bd77-91436ba7750c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ebfdac77-d547-424a-bd77-91436ba7750c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=ebfdac77-d547-424a-bd77-91436ba7750c,segment=NetworkSegment(a9f7e284-0af3-4e7c-8362-b09e14e08087),segment_id=a9f7e284-0af3-4e7c-8362-b09e14e08087)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:03:58.758140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ef29d0a2-dc52-4c9b-a3fd-65a221e72442 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ebfdac77-d547-424a-bd77-91436ba7750c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:59.182141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:482 started Oct 09 01:03:59.184622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f046,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=505000000,duration_sec=981,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:03:59.185199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:03:59.185534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:482 - starting polling. Elapsed:0.004 Oct 09 01:03:59.188097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:03:59.192105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:482 - port information retrieved. Elapsed:0.010 Oct 09 01:03:59.192432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:482 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:04:01.184166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:483 started Oct 09 01:04:01.189067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f048,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=507000000,duration_sec=983,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:01.194343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:01.195103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:483 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 01:04:01.375635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-383c468f-1692-45d9-9f0a-90db54e1298d tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:04:01Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7,mac_address=fa:16:3e:0a:05:14,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T01:04:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:01.376112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-383c468f-1692-45d9-9f0a-90db54e1298d tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:02.088396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-383c468f-1692-45d9-9f0a-90db54e1298d tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'a6a2847d-f9e4-42b3-ba56-3f8d8a7a266e'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:02.089132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-383c468f-1692-45d9-9f0a-90db54e1298d tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:03.185853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:484 started Oct 09 01:04:03.192559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f04a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=509000000,duration_sec=985,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:03.193163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:03.193499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:484 - starting polling. Elapsed:0.008 Oct 09 01:04:03.196140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:03.199551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:484 - port information retrieved. Elapsed:0.014 Oct 09 01:04:03.199905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:484 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 09 01:04:04.655958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port ebfdac77-d547-424a-bd77-91436ba7750c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:04.656569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ebfdac77-d547-424a-bd77-91436ba7750c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:05.186964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:485 started Oct 09 01:04:05.189346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f04c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=510000000,duration_sec=987,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:05.189911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:05.190238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:485 - starting polling. Elapsed:0.003 Oct 09 01:04:05.193322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:05.196825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:485 - port information retrieved. Elapsed:0.010 Oct 09 01:04:05.197151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:485 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:04:06.661106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port ebfdac77-d547-424a-bd77-91436ba7750c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:06.661711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ebfdac77-d547-424a-bd77-91436ba7750c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:07.187821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:486 started Oct 09 01:04:07.190110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f04e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=511000000,duration_sec=989,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:07.190662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:07.191020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:486 - starting polling. Elapsed:0.003 Oct 09 01:04:07.193669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:07.197149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:486 - port information retrieved. Elapsed:0.009 Oct 09 01:04:07.197476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:486 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:04:09.188554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:487 started Oct 09 01:04:09.191327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f050,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=512000000,duration_sec=991,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:09.192630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:09.193101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:487 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:04:11.189757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:488 started Oct 09 01:04:11.192755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f052,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=513000000,duration_sec=993,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:11.193342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:11.193699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:488 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:04:13.190506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:489 started Oct 09 01:04:13.192893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f054,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=514000000,duration_sec=995,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:13.193448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:13.193796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:489 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:15.191749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:490 started Oct 09 01:04:15.194053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f056,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=515000000,duration_sec=997,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:15.194610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:15.194963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:490 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:17.192631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:491 started Oct 09 01:04:17.194881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f058,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=516000000,duration_sec=999,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:17.195426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:17.195804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:491 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:19.193385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:492 started Oct 09 01:04:19.195805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f05a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=517000000,duration_sec=1001,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:19.196368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:19.196726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:492 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:19.864627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4158cd1f-956c-410a-b174-59da1ae27683 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:04:19Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d261ed89-daef-4376-9d38-9c7039162e42,mac_address=fa:16:3e:eb:87:d4,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d261ed89-daef-4376-9d38-9c7039162e42),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T01:04:19Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:19.865084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4158cd1f-956c-410a-b174-59da1ae27683 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d261ed89-daef-4376-9d38-9c7039162e42), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:20.507752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4158cd1f-956c-410a-b174-59da1ae27683 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource Port d261ed89-daef-4376-9d38-9c7039162e42 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '7fd5178b-cff5-45de-8a15-59b2b09df4ac'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:20.508876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4158cd1f-956c-410a-b174-59da1ae27683 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (d261ed89-daef-4376-9d38-9c7039162e42), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:21.194392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:493 started Oct 09 01:04:21.198087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f05c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=519000000,duration_sec=1003,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:21.198797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:21.199226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:493 - starting polling. Elapsed:0.005 Oct 09 01:04:21.202892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:21.206667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:493 - port information retrieved. Elapsed:0.012 Oct 09 01:04:21.207635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:493 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:04:21.315397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4375c3a4-1d2d-4671-8e5e-4b4de3d42b7c tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:04:21Z,description='tempest-secgroup-smoke-1915066342 description',id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,is_default=False,name='tempest-secgroup-smoke-1915066342',project_id='f37de57a22a246f0935f85392898dd42',revision_number=1,rules=[SecurityGroupRule(3466bffa-7c2f-4717-b8de-707100e5351f),SecurityGroupRule(cae2212f-a074-4a7b-ae55-49f376b97057)],shared=False,stateful=True,updated_at=2022-10-09T01:04:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:21.315940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4375c3a4-1d2d-4671-8e5e-4b4de3d42b7c tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (dc056f2c-4cfe-4712-a0d3-62e45f5a9644), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:21.316725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4375c3a4-1d2d-4671-8e5e-4b4de3d42b7c tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:21Z,description=,direction='egress',ethertype='IPv6',id=3466bffa-7c2f-4717-b8de-707100e5351f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,updated_at=2022-10-09T01:04:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:21.317182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4375c3a4-1d2d-4671-8e5e-4b4de3d42b7c tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3466bffa-7c2f-4717-b8de-707100e5351f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:21.317614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4375c3a4-1d2d-4671-8e5e-4b4de3d42b7c tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:04:21.318566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4375c3a4-1d2d-4671-8e5e-4b4de3d42b7c tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:21Z,description=,direction='egress',ethertype='IPv4',id=cae2212f-a074-4a7b-ae55-49f376b97057,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,updated_at=2022-10-09T01:04:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:21.318969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4375c3a4-1d2d-4671-8e5e-4b4de3d42b7c tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (cae2212f-a074-4a7b-ae55-49f376b97057), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:21.319435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4375c3a4-1d2d-4671-8e5e-4b4de3d42b7c tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:04:21.426917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8baa1378-3067-4b00-a955-7f2b34785c38 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:21Z,description='',direction='ingress',ethertype='IPv4',id=81aaf5ca-9c22-425b-a46e-66ee971349ce,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f37de57a22a246f0935f85392898dd42',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,updated_at=2022-10-09T01:04:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:21.427299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8baa1378-3067-4b00-a955-7f2b34785c38 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (81aaf5ca-9c22-425b-a46e-66ee971349ce), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:21.427667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8baa1378-3067-4b00-a955-7f2b34785c38 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:04:21.826290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2d972748-1f98-4059-bf59-e0d0f611cb75 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:21Z,description='',direction='egress',ethertype='IPv4',id=319fc572-d971-4599-bc9c-a2e7a38ebad1,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f37de57a22a246f0935f85392898dd42',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,updated_at=2022-10-09T01:04:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:21.826947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2d972748-1f98-4059-bf59-e0d0f611cb75 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (319fc572-d971-4599-bc9c-a2e7a38ebad1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:21.827080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-2d972748-1f98-4059-bf59-e0d0f611cb75 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:04:22.000966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b123f2e3-cc95-4319-a90c-b47e0630ca14 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:21Z,description='',direction='ingress',ethertype='IPv4',id=8206fc41-ff90-48e8-8235-cd7a02c10763,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,updated_at=2022-10-09T01:04:21Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:22.001629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b123f2e3-cc95-4319-a90c-b47e0630ca14 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (8206fc41-ff90-48e8-8235-cd7a02c10763), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:22.002225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b123f2e3-cc95-4319-a90c-b47e0630ca14 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:04:22.172640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4abcf4aa-df72-4208-be53-698430570ade tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:22Z,description='',direction='egress',ethertype='IPv4',id=2b715c9d-0932-419b-b0da-f8578655ad3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,updated_at=2022-10-09T01:04:22Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:22.173103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4abcf4aa-df72-4208-be53-698430570ade tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (2b715c9d-0932-419b-b0da-f8578655ad3b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:22.173566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4abcf4aa-df72-4208-be53-698430570ade tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:04:22.311492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce912795-023b-4814-ab25-9496bf9586f0 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:22Z,description='',direction='ingress',ethertype='IPv6',id=4643f680-e6ed-4ef4-a236-142bf4b5c1a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,updated_at=2022-10-09T01:04:22Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:22.312158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce912795-023b-4814-ab25-9496bf9586f0 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4643f680-e6ed-4ef4-a236-142bf4b5c1a8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:22.312711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ce912795-023b-4814-ab25-9496bf9586f0 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:04:22.457715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cd343bdc-f3e2-4e78-9479-afa9b465e2ca tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:22Z,description='',direction='egress',ethertype='IPv6',id=9104d9bf-13f1-4f08-8a0c-55be528b966c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37de57a22a246f0935f85392898dd42',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc056f2c-4cfe-4712-a0d3-62e45f5a9644,updated_at=2022-10-09T01:04:22Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:22.458230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cd343bdc-f3e2-4e78-9479-afa9b465e2ca tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9104d9bf-13f1-4f08-8a0c-55be528b966c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:22.458594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cd343bdc-f3e2-4e78-9479-afa9b465e2ca tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:04:23.025132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cfd210be-c2e9-4cb3-a69b-23500b670e8b tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource Port ebfdac77-d547-424a-bd77-91436ba7750c updated (revision_number 5->6). Old fields: {'security_group_ids': CoercedSet({'0795ffbb-6daf-4bba-a742-e224a73d68c6'})} New fields: {'security_group_ids': CoercedSet({'0795ffbb-6daf-4bba-a742-e224a73d68c6', 'dc056f2c-4cfe-4712-a0d3-62e45f5a9644'})} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:23.028406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cfd210be-c2e9-4cb3-a69b-23500b670e8b tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ebfdac77-d547-424a-bd77-91436ba7750c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:23.029435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-cfd210be-c2e9-4cb3-a69b-23500b670e8b tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group member updated {'0795ffbb-6daf-4bba-a742-e224a73d68c6', 'dc056f2c-4cfe-4712-a0d3-62e45f5a9644'} Oct 09 01:04:23.195936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:494 started Oct 09 01:04:23.202131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f05e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=523000000,duration_sec=1005,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:23.203571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:23.203940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:494 - starting polling. Elapsed:0.008 Oct 09 01:04:23.207730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:23.212725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:494 - port information retrieved. Elapsed:0.017 Oct 09 01:04:23.213991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:494 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 09 01:04:23.518633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb0cae1d-7f05-4e1b-89fa-36168898b4dc tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource Port deleted: a48d8008-24c8-488e-9a77-3b3d2c3b71b4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:04:23.524131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb0cae1d-7f05-4e1b-89fa-36168898b4dc tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (a48d8008-24c8-488e-9a77-3b3d2c3b71b4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:23.524547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eb0cae1d-7f05-4e1b-89fa-36168898b4dc tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group member updated {'14302cb8-4374-490f-af67-f2d863cd7361'} Oct 09 01:04:25.197317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:495 started Oct 09 01:04:25.199640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f060,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=521000000,duration_sec=1007,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:25.200205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:25.200536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:495 - starting polling. Elapsed:0.003 Oct 09 01:04:25.203047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:25.204805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 not present in bridge br-int Oct 09 01:04:25.205158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:04:25.205437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['a48d8008-24c8-488e-9a77-3b3d2c3b71b4'] Oct 09 01:04:25.205750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port a48d8008-24c8-488e-9a77-3b3d2c3b71b4 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:04:25.209213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:495 - port information retrieved. Elapsed:0.012 Oct 09 01:04:25.209543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:495 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 09 01:04:25.552253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroup deleted: 14302cb8-4374-490f-af67-f2d863cd7361 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:04:25.552726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (14302cb8-4374-490f-af67-f2d863cd7361), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:25.553279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('14302cb8-4374-490f-af67-f2d863cd7361',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:04:25.568767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('14302cb8-4374-490f-af67-f2d863cd7361',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:04:25.569328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroupRule deleted: 79084672-2c65-4057-b3d4-85dbbb6d0465 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:04:25.569767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (79084672-2c65-4057-b3d4-85dbbb6d0465), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:25.570171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['14302cb8-4374-490f-af67-f2d863cd7361'] Oct 09 01:04:25.570666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroupRule deleted: a8421430-bf33-4aa8-8264-41ee0fc47b80 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:04:25.571102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (a8421430-bf33-4aa8-8264-41ee0fc47b80), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:25.571677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['14302cb8-4374-490f-af67-f2d863cd7361'] Oct 09 01:04:25.572118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroupRule deleted: 6db815b6-4cee-42cc-9e42-6f2c7584013d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:04:25.572529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6db815b6-4cee-42cc-9e42-6f2c7584013d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:25.572886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['14302cb8-4374-490f-af67-f2d863cd7361'] Oct 09 01:04:25.573280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroupRule deleted: f42b57e1-6772-477d-bc2e-256f0a6b8a29 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:04:25.573619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f42b57e1-6772-477d-bc2e-256f0a6b8a29), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:25.574156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-fdea4481-1150-4101-8a04-46a7e79f9ca0 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['14302cb8-4374-490f-af67-f2d863cd7361'] Oct 09 01:04:25.956059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-aafa3bd7-902c-41b7-95f3-4f4a17c4c537 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource Port deleted: 0581945e-4b8a-4e1b-825c-669088720dab {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:04:25.956461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-aafa3bd7-902c-41b7-95f3-4f4a17c4c537 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (0581945e-4b8a-4e1b-825c-669088720dab), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:26.212758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b17dcd19-87c3-478f-8005-f93da84c1324 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:04:26Z,description='tempest-description--2043153562',id=8c40e0ac-a4c8-40aa-9db3-75e4c699d618,is_default=False,name='tempest-securitygroup--57864267',project_id='410212da4a794c07b30ed22cc5b7e760',revision_number=1,rules=[SecurityGroupRule(aea72606-ca1e-4f27-8296-0039bc5335eb),SecurityGroupRule(d4c9c414-2291-4b13-ae36-ecbb2012dd53)],shared=False,stateful=True,updated_at=2022-10-09T01:04:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:26.213390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b17dcd19-87c3-478f-8005-f93da84c1324 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (8c40e0ac-a4c8-40aa-9db3-75e4c699d618), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:26.213740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b17dcd19-87c3-478f-8005-f93da84c1324 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:26Z,description=,direction='egress',ethertype='IPv4',id=aea72606-ca1e-4f27-8296-0039bc5335eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8c40e0ac-a4c8-40aa-9db3-75e4c699d618,updated_at=2022-10-09T01:04:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:26.214093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b17dcd19-87c3-478f-8005-f93da84c1324 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (aea72606-ca1e-4f27-8296-0039bc5335eb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:26.214421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b17dcd19-87c3-478f-8005-f93da84c1324 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['8c40e0ac-a4c8-40aa-9db3-75e4c699d618'] Oct 09 01:04:26.215110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b17dcd19-87c3-478f-8005-f93da84c1324 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:26Z,description=,direction='egress',ethertype='IPv6',id=d4c9c414-2291-4b13-ae36-ecbb2012dd53,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8c40e0ac-a4c8-40aa-9db3-75e4c699d618,updated_at=2022-10-09T01:04:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:26.215452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b17dcd19-87c3-478f-8005-f93da84c1324 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d4c9c414-2291-4b13-ae36-ecbb2012dd53), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:26.215808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b17dcd19-87c3-478f-8005-f93da84c1324 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['8c40e0ac-a4c8-40aa-9db3-75e4c699d618'] Oct 09 01:04:26.325710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-78e96c29-d09e-4004-b711-b424878cb96e tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:26Z,description='',direction='ingress',ethertype='IPv4',id=7685e874-d9bd-4c39-a054-fb3692623717,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='410212da4a794c07b30ed22cc5b7e760',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8c40e0ac-a4c8-40aa-9db3-75e4c699d618,updated_at=2022-10-09T01:04:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:26.326090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-78e96c29-d09e-4004-b711-b424878cb96e tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (7685e874-d9bd-4c39-a054-fb3692623717), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:26.326429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-78e96c29-d09e-4004-b711-b424878cb96e tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['8c40e0ac-a4c8-40aa-9db3-75e4c699d618'] Oct 09 01:04:26.465738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b433194a-02a2-4f0a-ab37-883c8ccd63e8 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:04:26Z,description='',direction='ingress',ethertype='IPv4',id=3654bf6f-217d-4718-950f-6acada24a843,normalized_cidr=None,port_range_max=,port_range_min=,project_id='410212da4a794c07b30ed22cc5b7e760',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8c40e0ac-a4c8-40aa-9db3-75e4c699d618,updated_at=2022-10-09T01:04:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:26.466112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b433194a-02a2-4f0a-ab37-883c8ccd63e8 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3654bf6f-217d-4718-950f-6acada24a843), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:26.466485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b433194a-02a2-4f0a-ab37-883c8ccd63e8 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['8c40e0ac-a4c8-40aa-9db3-75e4c699d618'] Oct 09 01:04:26.894416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edcbab2f-a92d-4dec-b894-eba49ef73caa tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:04:26Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=606f5503-a88d-401a-826c-23c0ab125c2e,mac_address=fa:16:3e:ca:6f:60,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(606f5503-a88d-401a-826c-23c0ab125c2e),security_group_ids=set([]),status='N/A',updated_at=2022-10-09T01:04:26Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:26.894808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edcbab2f-a92d-4dec-b894-eba49ef73caa tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (606f5503-a88d-401a-826c-23c0ab125c2e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:27.198595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:496 started Oct 09 01:04:27.201131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f062,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=522000000,duration_sec=1009,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:27.201930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:27.202267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:496 - starting polling. Elapsed:0.004 Oct 09 01:04:27.204879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:27.206656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 0581945e-4b8a-4e1b-825c-669088720dab not present in bridge br-int Oct 09 01:04:27.207548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:04:27.207882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['0581945e-4b8a-4e1b-825c-669088720dab'] Oct 09 01:04:27.208227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 0581945e-4b8a-4e1b-825c-669088720dab is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:04:27.211576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:496 - port information retrieved. Elapsed:0.013 Oct 09 01:04:27.211935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:496 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 09 01:04:27.236165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edcbab2f-a92d-4dec-b894-eba49ef73caa tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource Port 606f5503-a88d-401a-826c-23c0ab125c2e updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'd7e13b59-6fdb-49a2-a08e-7aa155017298'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:27.236767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edcbab2f-a92d-4dec-b894-eba49ef73caa tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (606f5503-a88d-401a-826c-23c0ab125c2e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:29.199247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:497 started Oct 09 01:04:29.202548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f064,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=523000000,duration_sec=1011,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:29.203373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:29.204041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:497 - starting polling. Elapsed:0.005 Oct 09 01:04:29.207478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:29.210993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:497 - port information retrieved. Elapsed:0.012 Oct 09 01:04:29.211325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:497 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 09 01:04:30.167940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-835544b8-f94d-40d3-adc3-e98a57703e11 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:04:29Z,data_plane_status=None,description='',device_id='406c4931-6ce2-45ec-bea3-b60d04e150c9',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=41d333d7-a33b-44cc-9e3c-2de2e0120491,mac_address=fa:16:3e:28:14:b0,name='',network_id=d442b64f-563d-410a-8314-ec0e04e8ccd0,numa_affinity_policy=,project_id='410212da4a794c07b30ed22cc5b7e760',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(41d333d7-a33b-44cc-9e3c-2de2e0120491),security_group_ids=set([8c40e0ac-a4c8-40aa-9db3-75e4c699d618]),status='DOWN',updated_at=2022-10-09T01:04:29Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:04:30.168724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-835544b8-f94d-40d3-adc3-e98a57703e11 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:30.169950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-835544b8-f94d-40d3-adc3-e98a57703e11 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group member updated {'8c40e0ac-a4c8-40aa-9db3-75e4c699d618'} Oct 09 01:04:30.634559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1a9a7061-15cc-4980-b571-1ef722f53b51 service neutron] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=41d333d7-a33b-44cc-9e3c-2de2e0120491,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=41d333d7-a33b-44cc-9e3c-2de2e0120491,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:30.635191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1a9a7061-15cc-4980-b571-1ef722f53b51 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:30.894875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1a9a7061-15cc-4980-b571-1ef722f53b51 service neutron] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=41d333d7-a33b-44cc-9e3c-2de2e0120491,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=41d333d7-a33b-44cc-9e3c-2de2e0120491,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=41d333d7-a33b-44cc-9e3c-2de2e0120491,segment=NetworkSegment(36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5),segment_id=36dc6af5-3b37-4d1b-ad81-ffd27cf99cf5)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:30.895247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1a9a7061-15cc-4980-b571-1ef722f53b51 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:31.199782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:498 started Oct 09 01:04:31.202325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f066,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=523000000,duration_sec=1013,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:31.202913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:31.203243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:498 - starting polling. Elapsed:0.004 Oct 09 01:04:31.205811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:31.209244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:498 - port information retrieved. Elapsed:0.010 Oct 09 01:04:31.209568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:498 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:04:33.200937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:499 started Oct 09 01:04:33.203206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f068,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=524000000,duration_sec=1015,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:33.203783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:33.204126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:499 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:34.803702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:34.804312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:35.202323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:500 started Oct 09 01:04:35.204637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f06a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=526000000,duration_sec=1017,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:35.205219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:35.205551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:500 - starting polling. Elapsed:0.003 Oct 09 01:04:35.208704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:35.212198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:500 - port information retrieved. Elapsed:0.010 Oct 09 01:04:35.212534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:500 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:04:36.910577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:04:36.911201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:37.203211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:501 started Oct 09 01:04:37.205936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f06c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=527000000,duration_sec=1019,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:37.206511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:37.207399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:501 - starting polling. Elapsed:0.004 Oct 09 01:04:37.210000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:04:37.213471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:501 - port information retrieved. Elapsed:0.010 Oct 09 01:04:37.213805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:501 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 09 01:04:39.204455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:502 started Oct 09 01:04:39.210814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f06e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=528000000,duration_sec=1021,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:39.211380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:39.211783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:502 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 01:04:41.205329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:503 started Oct 09 01:04:41.207957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f070,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=529000000,duration_sec=1023,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:41.208524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:41.208876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:503 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:04:43.206423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:504 started Oct 09 01:04:43.209299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f072,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=530000000,duration_sec=1025,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:43.209852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:43.210201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:504 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:04:45.207815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:505 started Oct 09 01:04:45.210172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f074,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=531000000,duration_sec=1027,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:45.210729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:45.211083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:505 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:47.208823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:506 started Oct 09 01:04:47.215410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f076,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=532000000,duration_sec=1029,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:47.216031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:47.216391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:506 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:04:49.209741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:507 started Oct 09 01:04:49.212211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f078,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=533000000,duration_sec=1031,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:49.212834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:49.213195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:507 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:04:51.210135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:508 started Oct 09 01:04:51.212455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f07a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=533000000,duration_sec=1033,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:51.213009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:51.213356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:508 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:53.211534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:509 started Oct 09 01:04:53.213766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f07c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=535000000,duration_sec=1035,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:53.214311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:53.214658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:509 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:55.212912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:510 started Oct 09 01:04:55.215250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f07e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=536000000,duration_sec=1037,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:55.215864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:55.216217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:510 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:04:57.213741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:511 started Oct 09 01:04:57.216331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f080,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=537000000,duration_sec=1039,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:57.216933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:57.217278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:511 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:04:59.214656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:512 started Oct 09 01:04:59.217032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f082,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=538000000,duration_sec=1041,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:04:59.217586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:04:59.217936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:512 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:01.215810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:513 started Oct 09 01:05:01.218366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f084,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=539000000,duration_sec=1043,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:01.218916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:01.219268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:513 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:05:03.216950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:514 started Oct 09 01:05:03.219519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f086,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=541000000,duration_sec=1045,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:03.220099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:03.220449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:514 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:05:05.217965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:515 started Oct 09 01:05:05.220311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f088,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=541000000,duration_sec=1047,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:05.220871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:05.221248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:515 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:07.218629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:516 started Oct 09 01:05:07.221002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f08a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=542000000,duration_sec=1049,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:07.221591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:07.222064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:516 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:09.219448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:517 started Oct 09 01:05:09.221774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f08c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=543000000,duration_sec=1051,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:09.222329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:09.222722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:517 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:11.220826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:518 started Oct 09 01:05:11.223430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f08e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=544000000,duration_sec=1053,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:11.224026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:11.224379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:518 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:05:13.221600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:519 started Oct 09 01:05:13.224440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f090,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=545000000,duration_sec=1055,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:13.225001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:13.225355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:519 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:05:15.222443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:520 started Oct 09 01:05:15.224793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f092,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=546000000,duration_sec=1057,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:15.225344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:15.225686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:520 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:17.223319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:521 started Oct 09 01:05:17.225676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f094,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=547000000,duration_sec=1059,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:17.226226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:17.226580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:521 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:19.224063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:522 started Oct 09 01:05:19.226313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f096,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=547000000,duration_sec=1061,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:19.226856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:19.227200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:522 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:21.225527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:523 started Oct 09 01:05:21.229912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f098,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=549000000,duration_sec=1063,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:21.230511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:21.230934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:523 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 01:05:23.226616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:524 started Oct 09 01:05:23.228862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f09a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=550000000,duration_sec=1065,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:23.229418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:23.229768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:524 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:25.226967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:525 started Oct 09 01:05:25.229811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f09c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=551000000,duration_sec=1067,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:25.230397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:25.230746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:525 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:05:27.228039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:526 started Oct 09 01:05:27.230761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f09e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=551000000,duration_sec=1069,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:27.231374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:27.231758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:526 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:05:29.228590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:527 started Oct 09 01:05:29.230853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=552000000,duration_sec=1071,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:29.231415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:29.231808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:527 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:31.229177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:528 started Oct 09 01:05:31.232786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=553000000,duration_sec=1073,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:31.233338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:31.233688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:528 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:05:33.230372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:529 started Oct 09 01:05:33.232623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=554000000,duration_sec=1075,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:33.233169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:33.233517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:529 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:35.231223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:530 started Oct 09 01:05:35.233571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=555000000,duration_sec=1077,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:35.234128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:35.234478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:530 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:05:37.263173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:531 started Oct 09 01:05:37.269495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=589000000,duration_sec=1079,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:37.269955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:37.270361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:531 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:05:37.307817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:05:37.308329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:38.875046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-deea5cc2-a733-42b6-b1bb-614acbf45253 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource Port ebfdac77-d547-424a-bd77-91436ba7750c updated (revision_number 6->7). Old fields: {'security_group_ids': CoercedSet({'0795ffbb-6daf-4bba-a742-e224a73d68c6', 'dc056f2c-4cfe-4712-a0d3-62e45f5a9644'})} New fields: {'security_group_ids': CoercedSet({'0795ffbb-6daf-4bba-a742-e224a73d68c6'})} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:05:38.875666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-deea5cc2-a733-42b6-b1bb-614acbf45253 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (ebfdac77-d547-424a-bd77-91436ba7750c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:38.875875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-deea5cc2-a733-42b6-b1bb-614acbf45253 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group member updated {'0795ffbb-6daf-4bba-a742-e224a73d68c6', 'dc056f2c-4cfe-4712-a0d3-62e45f5a9644'} Oct 09 01:05:39.107202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroup deleted: dc056f2c-4cfe-4712-a0d3-62e45f5a9644 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.107893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (dc056f2c-4cfe-4712-a0d3-62e45f5a9644), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.108535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dc056f2c-4cfe-4712-a0d3-62e45f5a9644',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:05:39.173002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dc056f2c-4cfe-4712-a0d3-62e45f5a9644',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:05:39.173731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroupRule deleted: 3466bffa-7c2f-4717-b8de-707100e5351f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.174327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3466bffa-7c2f-4717-b8de-707100e5351f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.175040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:05:39.175613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroupRule deleted: cae2212f-a074-4a7b-ae55-49f376b97057 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.176128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (cae2212f-a074-4a7b-ae55-49f376b97057), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.176797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:05:39.177366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroupRule deleted: 81aaf5ca-9c22-425b-a46e-66ee971349ce {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.177955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (81aaf5ca-9c22-425b-a46e-66ee971349ce), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.178620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:05:39.181234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroupRule deleted: 319fc572-d971-4599-bc9c-a2e7a38ebad1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.181662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (319fc572-d971-4599-bc9c-a2e7a38ebad1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.182077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:05:39.182449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroupRule deleted: 8206fc41-ff90-48e8-8235-cd7a02c10763 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.182854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8206fc41-ff90-48e8-8235-cd7a02c10763), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.183122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:05:39.183494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroupRule deleted: 2b715c9d-0932-419b-b0da-f8578655ad3b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.184118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (2b715c9d-0932-419b-b0da-f8578655ad3b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.184259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:05:39.184535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroupRule deleted: 4643f680-e6ed-4ef4-a236-142bf4b5c1a8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.187645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4643f680-e6ed-4ef4-a236-142bf4b5c1a8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.187974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:05:39.188294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource SecurityGroupRule deleted: 9104d9bf-13f1-4f08-8a0c-55be528b966c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.188621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9104d9bf-13f1-4f08-8a0c-55be528b966c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.188948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-7a757b59-c470-4cf3-a6cd-a53d4fc21389 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group rule updated ['dc056f2c-4cfe-4712-a0d3-62e45f5a9644'] Oct 09 01:05:39.261543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:532 started Oct 09 01:05:39.264231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=585000000,duration_sec=1081,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:39.264918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:39.265256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:532 - starting polling. Elapsed:0.004 Oct 09 01:05:39.268641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.276460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:532 - port information retrieved. Elapsed:0.015 Oct 09 01:05:39.277039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:532 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 09 01:05:39.516936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:05:39.517470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:39.727409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3bcbdc0f-5f8e-4f29-b3cf-4b48f90ef8b1 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource Port deleted: d261ed89-daef-4376-9d38-9c7039162e42 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:39.728880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3bcbdc0f-5f8e-4f29-b3cf-4b48f90ef8b1 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (d261ed89-daef-4376-9d38-9c7039162e42), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:41.262171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:533 started Oct 09 01:05:41.265626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=586000000,duration_sec=1083,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:41.266457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:41.267059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:533 - starting polling. Elapsed:0.005 Oct 09 01:05:41.270481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:41.278618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port d261ed89-daef-4376-9d38-9c7039162e42 not present in bridge br-int Oct 09 01:05:41.279326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:05:41.279874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['d261ed89-daef-4376-9d38-9c7039162e42'] Oct 09 01:05:41.280617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port d261ed89-daef-4376-9d38-9c7039162e42 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:05:41.284413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:533 - port information retrieved. Elapsed:0.022 Oct 09 01:05:41.285011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:533 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Oct 09 01:05:43.263851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:534 started Oct 09 01:05:43.266846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=587000000,duration_sec=1085,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:43.267804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:43.268158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:534 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:05:43.284349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4622cb82-e75d-4880-a0a3-ba5fefb11b05 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port deleted: c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:43.284725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4622cb82-e75d-4880-a0a3-ba5fefb11b05 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:45.264798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:535 started Oct 09 01:05:45.268328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=589000000,duration_sec=1087,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:45.269255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:45.269814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:535 - starting polling. Elapsed:0.005 Oct 09 01:05:45.272677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:45.274973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7 not present in bridge br-int Oct 09 01:05:45.275559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:05:45.275928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7'] Oct 09 01:05:45.276436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port c2ac695e-2507-4b0c-bc78-d3e2c3f2a3c7 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:05:45.280574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:535 - port information retrieved. Elapsed:0.016 Oct 09 01:05:45.281124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:535 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 09 01:05:47.251610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4f416042-d249-4000-a37d-b92f526c3315 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port deleted: 07d4f0c5-1202-4554-b832-08bb967ca163 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:47.254269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4f416042-d249-4000-a37d-b92f526c3315 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (07d4f0c5-1202-4554-b832-08bb967ca163), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:47.255936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4f416042-d249-4000-a37d-b92f526c3315 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group member updated {'45da6575-619b-423b-bc04-7f831c564029'} Oct 09 01:05:47.266818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:536 started Oct 09 01:05:47.273244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=591000000,duration_sec=1089,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:47.273818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:47.279166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:536 - starting polling. Elapsed:0.012 Oct 09 01:05:47.281751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:47.283497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 07d4f0c5-1202-4554-b832-08bb967ca163 not present in bridge br-int Oct 09 01:05:47.283865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:05:47.290443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['07d4f0c5-1202-4554-b832-08bb967ca163'] Oct 09 01:05:47.290990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 07d4f0c5-1202-4554-b832-08bb967ca163 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:05:47.294754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:536 - port information retrieved. Elapsed:0.028 Oct 09 01:05:47.295271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:536 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.029 Oct 09 01:05:47.410933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0b352532-9ba1-41a2-9cfe-63b91746ba35 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Resource Port deleted: ebfdac77-d547-424a-bd77-91436ba7750c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:47.411359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0b352532-9ba1-41a2-9cfe-63b91746ba35 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (ebfdac77-d547-424a-bd77-91436ba7750c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:47.411981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0b352532-9ba1-41a2-9cfe-63b91746ba35 tempest-TestMinimumBasicScenario-747022156 tempest-TestMinimumBasicScenario-747022156-project] Security group member updated {'0795ffbb-6daf-4bba-a742-e224a73d68c6'} Oct 09 01:05:49.268350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:537 started Oct 09 01:05:49.270985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=592000000,duration_sec=1091,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:49.271540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:49.271914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:537 - starting polling. Elapsed:0.004 Oct 09 01:05:49.274967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:49.276730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port ebfdac77-d547-424a-bd77-91436ba7750c not present in bridge br-int Oct 09 01:05:49.277063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:05:49.277336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['ebfdac77-d547-424a-bd77-91436ba7750c'] Oct 09 01:05:49.277901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port ebfdac77-d547-424a-bd77-91436ba7750c is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:05:49.281232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:537 - port information retrieved. Elapsed:0.013 Oct 09 01:05:49.281555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:537 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:05:49.921351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1c1576c9-9503-41ec-bdc8-c21b210b3568 admin admin] Resource Port deleted: 14973d20-f33b-4361-a1f8-ebeb1bf4ca82 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:49.923024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1c1576c9-9503-41ec-bdc8-c21b210b3568 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (14973d20-f33b-4361-a1f8-ebeb1bf4ca82), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:51.027287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-cca78e1a-c375-4b3e-b2a1-d62aaa530e42 admin admin] Resource Port deleted: f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:51.028595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-cca78e1a-c375-4b3e-b2a1-d62aaa530e42 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (f1fb537b-7bbd-40c4-9fa9-2d496f13cb55), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:51.150048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7c711e8e-0120-4f6d-a182-8f6562695f6c","delete","qr-14973d20-f3",28,["map",[["attached-mac","fa:16:3e:c3:53:16"],["iface-id","14973d20-f33b-4361-a1f8-ebeb1bf4ca82"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:05:51.270377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:538 started Oct 09 01:05:51.310477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:05:51.310855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:51.435859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=752000000,duration_sec=1093,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:51.438553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:51.439226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:538 - starting polling. Elapsed:0.169 Oct 09 01:05:51.442813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:51.448267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f1fb537b-7b, col_values=(('tag', 4095),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:05:51.461042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0b8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:51.461461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['f1fb537b-7bbd-40c4-9fa9-2d496f13cb55'] Oct 09 01:05:51.462603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:05:51.517822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2cf9e342-66cd-4c35-ac46-f30769846a52 admin admin] Resource Subnet deleted: 98b6e2f7-a736-4245-b55d-f9e6c9acd558 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:51.518473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2cf9e342-66cd-4c35-ac46-f30769846a52 admin admin] Publish callbacks [] for Subnet (98b6e2f7-a736-4245-b55d-f9e6c9acd558), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:51.528675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2829cf-1b28-4787-a084-335d3a181e96]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:05:51.535442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0ba,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:51.535791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:538 - port information retrieved. Elapsed:0.266 Oct 09 01:05:51.536306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'e117ae0c-3834-457d-833e-82227f33c129', 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', '58897c2b-173b-4d6c-a17a-700b101c1987', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'14973d20-f33b-4361-a1f8-ebeb1bf4ca82'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:05:51.536632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:538 - agent port security group processed in 0.000 Oct 09 01:05:51.539009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:05:51.539308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'14973d20-f33b-4361-a1f8-ebeb1bf4ca82'} Oct 09 01:05:51.539799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:05:51.594900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db75fb-0ecd-42dc-a0c4-b8be09dbda9b]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:05:51.595505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'14973d20-f33b-4361-a1f8-ebeb1bf4ca82'} removed Oct 09 01:05:51.643497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["47befcd7-f080-43c1-b818-07bdd4c2b20b","delete","qg-f1fb537b-7b",29,["map",[["attached-mac","fa:16:3e:c1:f8:e4"],["iface-id","f1fb537b-7bbd-40c4-9fa9-2d496f13cb55"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:05:51.661910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:05:51.662380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:538 - treat_devices_removed completed in 0.123 Oct 09 01:05:51.662672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:538 - ports processed. Elapsed:0.393 Oct 09 01:05:51.663024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:538 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.393 Oct 09 01:05:51.724203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8e5e5887-cbba-4720-a8fe-0dd86942bfd1","delete","tap58897c2b-17",27,["map",[["attached-mac","fa:16:3e:a9:af:38"],["iface-id","58897c2b-173b-4d6c-a17a-700b101c1987"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:05:51.899659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-893254d6-65f7-4418-afb2-f5dbd569a9f0 admin admin] Resource Port deleted: 58897c2b-173b-4d6c-a17a-700b101c1987 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:51.900153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-893254d6-65f7-4418-afb2-f5dbd569a9f0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (58897c2b-173b-4d6c-a17a-700b101c1987), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:52.154845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-893254d6-65f7-4418-afb2-f5dbd569a9f0 admin admin] Resource Network deleted: 6785419e-1d43-419a-bc35-ef45112ab443 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:52.155404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-893254d6-65f7-4418-afb2-f5dbd569a9f0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (6785419e-1d43-419a-bc35-ef45112ab443), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:52.997520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-775fb0c3-f0e3-459e-b502-745cf117a036 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port deleted: b6e09be5-fa81-42d1-9e3d-4510f834a534 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:52.997902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-775fb0c3-f0e3-459e-b502-745cf117a036 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (b6e09be5-fa81-42d1-9e3d-4510f834a534), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:53.272354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:539 started Oct 09 01:05:53.277035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=596000000,duration_sec=1095,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:53.278343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:53.279013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:539 - starting polling. Elapsed:0.007 Oct 09 01:05:53.282309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:53.286573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port b6e09be5-fa81-42d1-9e3d-4510f834a534 not present in bridge br-int Oct 09 01:05:53.287209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:05:53.288375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['b6e09be5-fa81-42d1-9e3d-4510f834a534'] Oct 09 01:05:53.288928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port b6e09be5-fa81-42d1-9e3d-4510f834a534 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:05:53.296937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0be,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:53.300323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0c0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:53.301356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:539 - port information retrieved. Elapsed:0.029 Oct 09 01:05:53.301929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'be87fabf-44c3-4811-bd4f-74e4a5079a6d', 'e117ae0c-3834-457d-833e-82227f33c129', 'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', '58897c2b-173b-4d6c-a17a-700b101c1987'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:05:53.302976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:539 - agent port security group processed in 0.000 Oct 09 01:05:53.307186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:05:53.308127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', '58897c2b-173b-4d6c-a17a-700b101c1987'} Oct 09 01:05:53.310263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f1fb537b-7bbd-40c4-9fa9-2d496f13cb55 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:05:53.311278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:05:53.357445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b886ce9-0539-49ba-9c22-65c6a99c39e7]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:05:53.358928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'f1fb537b-7bbd-40c4-9fa9-2d496f13cb55', '58897c2b-173b-4d6c-a17a-700b101c1987'} removed Oct 09 01:05:53.429392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:05:53.430813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:05:53.432367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 11 from net-id = 6785419e-1d43-419a-bc35-ef45112ab443, seg-id = 671 Oct 09 01:05:53.438975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da1841,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:53.442853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363f0c2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4767}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:53.443336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:539 - treat_devices_removed completed in 0.135 Oct 09 01:05:53.443803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:539 - ports processed. Elapsed:0.172 Oct 09 01:05:53.444228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:539 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.173 Oct 09 01:05:53.536526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2744acdb-1880-4777-9f7a-7abc2396611f admin admin] Resource Port deleted: e4bdc121-2f27-45a0-bc01-9927bf7604d8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:53.537020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-2744acdb-1880-4777-9f7a-7abc2396611f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (e4bdc121-2f27-45a0-bc01-9927bf7604d8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:54.780603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d7f7ab11-14fd-4559-acc3-5ab64d7cbebd","delete","qr-e4bdc121-2f",31,["map",[["attached-mac","fa:16:3e:6e:b7:1d"],["iface-id","e4bdc121-2f27-45a0-bc01-9927bf7604d8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:05:54.796832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1e8c377f-6396-46e5-96dd-424ff4ebb041 admin admin] Resource Port deleted: be87fabf-44c3-4811-bd4f-74e4a5079a6d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:54.797328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1e8c377f-6396-46e5-96dd-424ff4ebb041 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (be87fabf-44c3-4811-bd4f-74e4a5079a6d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:55.225789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a9ded6a1-08c7-463b-8d73-8e6c214f237e","delete","qg-be87fabf-44",32,["map",[["attached-mac","fa:16:3e:e0:e5:9e"],["iface-id","be87fabf-44c3-4811-bd4f-74e4a5079a6d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:05:55.273016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:540 started Oct 09 01:05:55.413735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-bc39f002-3d5d-4ea7-a520-0bf6150a7b4d admin admin] Resource Subnet deleted: f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:55.414158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-bc39f002-3d5d-4ea7-a520-0bf6150a7b4d admin admin] Publish callbacks [] for Subnet (f17d9b80-b0d3-4cbc-87fd-1c6f86c3cfe1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:55.531511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=852000000,duration_sec=1097,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:55.533244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:55.533908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:540 - starting polling. Elapsed:0.261 Oct 09 01:05:55.536438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:55.575143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0c6,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:55.581793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0c8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:55.582117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:540 - port information retrieved. Elapsed:0.309 Oct 09 01:05:55.582455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '0323fb7d-0982-4e2d-8701-9118321c427f', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'be87fabf-44c3-4811-bd4f-74e4a5079a6d'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:05:55.582780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:540 - agent port security group processed in 0.000 Oct 09 01:05:55.585145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:05:55.585447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'be87fabf-44c3-4811-bd4f-74e4a5079a6d'} Oct 09 01:05:55.585941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 8 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:05:55.602988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c1490ad2-24c9-420f-9976-956e73905b2a","delete","tap0323fb7d-09",30,["map",[["attached-mac","fa:16:3e:0b:8c:7d"],["iface-id","0323fb7d-0982-4e2d-8701-9118321c427f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:05:55.669232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858aa5d-b742-4e3e-b70e-e56cc64cdb0c]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:05:55.669825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'e4bdc121-2f27-45a0-bc01-9927bf7604d8', 'be87fabf-44c3-4811-bd4f-74e4a5079a6d'} removed Oct 09 01:05:55.751184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:05:55.751892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:540 - treat_devices_removed completed in 0.166 Oct 09 01:05:55.752377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:540 - ports processed. Elapsed:0.480 Oct 09 01:05:55.752866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:540 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.480 Oct 09 01:05:55.990911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-147893d0-8b9e-4518-98bd-d0e53c055e08 None None] Resource Port deleted: 0323fb7d-0982-4e2d-8701-9118321c427f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:55.991490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-147893d0-8b9e-4518-98bd-d0e53c055e08 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (0323fb7d-0982-4e2d-8701-9118321c427f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:56.153529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-10db30c1-7730-49a2-9774-9454324379ca admin admin] Resource Port deleted: 0323fb7d-0982-4e2d-8701-9118321c427f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:56.154203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-10db30c1-7730-49a2-9774-9454324379ca admin admin] Skipped duplicate delete event for 0323fb7d-0982-4e2d-8701-9118321c427f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 09 01:05:56.512344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-10db30c1-7730-49a2-9774-9454324379ca admin admin] Resource Network deleted: eb19f52f-afcc-41bb-9895-b089b3330962 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:56.513659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-10db30c1-7730-49a2-9774-9454324379ca admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (eb19f52f-afcc-41bb-9895-b089b3330962), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:56.612310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-121e6262-8569-453e-aef7-b4508ab68d7a tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port deleted: 92161e7f-b2e3-4be5-9ff8-073cd2234c8e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:56.612829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-121e6262-8569-453e-aef7-b4508ab68d7a tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (92161e7f-b2e3-4be5-9ff8-073cd2234c8e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:56.613242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-121e6262-8569-453e-aef7-b4508ab68d7a tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group member updated {'45da6575-619b-423b-bc04-7f831c564029'} Oct 09 01:05:56.924433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Resource SecurityGroup deleted: 0795ffbb-6daf-4bba-a742-e224a73d68c6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:56.925347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (0795ffbb-6daf-4bba-a742-e224a73d68c6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:56.926332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0795ffbb-6daf-4bba-a742-e224a73d68c6',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:05:56.953393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0795ffbb-6daf-4bba-a742-e224a73d68c6',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:05:56.954004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Resource SecurityGroupRule deleted: 15e95934-298a-490b-a2ae-31288aa83a4a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:56.954434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (15e95934-298a-490b-a2ae-31288aa83a4a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:56.954832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Security group rule updated ['0795ffbb-6daf-4bba-a742-e224a73d68c6'] Oct 09 01:05:56.955681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Resource SecurityGroupRule deleted: 1d1612a6-5cd0-4080-b7bd-91e114aa4cbc {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:56.956131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1d1612a6-5cd0-4080-b7bd-91e114aa4cbc), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:56.956857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Security group rule updated ['0795ffbb-6daf-4bba-a742-e224a73d68c6'] Oct 09 01:05:56.957424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Resource SecurityGroupRule deleted: 9585c10e-8b97-4a7e-bcc3-0bc475ba7dee {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:56.958341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9585c10e-8b97-4a7e-bcc3-0bc475ba7dee), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:56.958898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Security group rule updated ['0795ffbb-6daf-4bba-a742-e224a73d68c6'] Oct 09 01:05:56.959458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Resource SecurityGroupRule deleted: e5b7a36c-8e9d-4d56-955e-a88091f5b954 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:56.960030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e5b7a36c-8e9d-4d56-955e-a88091f5b954), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:56.960415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edfe0c9a-2e78-462e-a5bf-aabdd2837a7d admin admin] Security group rule updated ['0795ffbb-6daf-4bba-a742-e224a73d68c6'] Oct 09 01:05:57.275436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:541 started Oct 09 01:05:57.280678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=600000000,duration_sec=1099,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:57.282024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:57.282563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:541 - starting polling. Elapsed:0.008 Oct 09 01:05:57.286013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:57.288710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 92161e7f-b2e3-4be5-9ff8-073cd2234c8e not present in bridge br-int Oct 09 01:05:57.289878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:05:57.290577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['92161e7f-b2e3-4be5-9ff8-073cd2234c8e'] Oct 09 01:05:57.291204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 92161e7f-b2e3-4be5-9ff8-073cd2234c8e is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:05:57.301153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0cc,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:57.301908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:541 - port information retrieved. Elapsed:0.028 Oct 09 01:05:57.302632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '546af4ee-57b8-4aab-a465-e176e85a3fa1', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'0323fb7d-0982-4e2d-8701-9118321c427f'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:05:57.303272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:541 - agent port security group processed in 0.000 Oct 09 01:05:57.306704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:05:57.307305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'0323fb7d-0982-4e2d-8701-9118321c427f'} Oct 09 01:05:57.308259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:05:57.390074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001554a-9d5a-426f-ac42-3fa12116b914]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:05:57.393962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'0323fb7d-0982-4e2d-8701-9118321c427f'} removed Oct 09 01:05:57.438824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:05:57.439904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 12 from net-id = eb19f52f-afcc-41bb-9895-b089b3330962, seg-id = 676 Oct 09 01:05:57.444844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da1843,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:57.449691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363f0ce,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4772}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:57.450233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:541 - treat_devices_removed completed in 0.143 Oct 09 01:05:57.450687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:541 - ports processed. Elapsed:0.176 Oct 09 01:05:57.451202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:541 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.177 Oct 09 01:05:57.810864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Resource SecurityGroup deleted: 2edb6e4f-1dea-408d-aced-d7192ae453bb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:57.811662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (2edb6e4f-1dea-408d-aced-d7192ae453bb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:57.812335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2edb6e4f-1dea-408d-aced-d7192ae453bb',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:05:57.843106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2edb6e4f-1dea-408d-aced-d7192ae453bb',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:05:57.843695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Resource SecurityGroupRule deleted: 16ba3a12-d2bc-4fb7-a4b7-0eeffa022a55 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:57.844160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (16ba3a12-d2bc-4fb7-a4b7-0eeffa022a55), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:57.844557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Security group rule updated ['2edb6e4f-1dea-408d-aced-d7192ae453bb'] Oct 09 01:05:57.845023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Resource SecurityGroupRule deleted: 410f8fb3-4d23-44d7-868d-fed01d4119b4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:57.845467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (410f8fb3-4d23-44d7-868d-fed01d4119b4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:57.845866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Security group rule updated ['2edb6e4f-1dea-408d-aced-d7192ae453bb'] Oct 09 01:05:57.846328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Resource SecurityGroupRule deleted: 56ccec15-f819-42d4-9aca-c49aef1c54ca {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:57.846734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (56ccec15-f819-42d4-9aca-c49aef1c54ca), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:57.847118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Security group rule updated ['2edb6e4f-1dea-408d-aced-d7192ae453bb'] Oct 09 01:05:57.847730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Resource SecurityGroupRule deleted: 7a606972-8d08-4dde-a842-49b398dd111b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:05:57.848138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7a606972-8d08-4dde-a842-49b398dd111b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:05:57.848527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3dc6a59e-8eb1-450d-8668-e4de95071c81 admin admin] Security group rule updated ['2edb6e4f-1dea-408d-aced-d7192ae453bb'] Oct 09 01:05:59.275831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:542 started Oct 09 01:05:59.278556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=599000000,duration_sec=1101,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:05:59.279144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:05:59.279524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:542 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:01.276524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:543 started Oct 09 01:06:01.279162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=600000000,duration_sec=1103,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:01.279790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:01.280170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:543 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:03.277894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:544 started Oct 09 01:06:03.285777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=603000000,duration_sec=1105,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:03.286404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:03.286766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:544 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 01:06:05.278601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:545 started Oct 09 01:06:05.281611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=602000000,duration_sec=1107,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:05.282130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:05.283917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:545 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 01:06:07.156604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-25987071-c7d1-44cc-8c6e-a2a3a0daaea9 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource Port deleted: 7de0dd97-55b5-4e6a-820d-3c84d30f92c4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:07.158237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-25987071-c7d1-44cc-8c6e-a2a3a0daaea9 tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (7de0dd97-55b5-4e6a-820d-3c84d30f92c4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:07.280320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:546 started Oct 09 01:06:07.283282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=604000000,duration_sec=1109,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:07.283974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:07.284389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:546 - starting polling. Elapsed:0.005 Oct 09 01:06:07.286801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:07.288404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 7de0dd97-55b5-4e6a-820d-3c84d30f92c4 not present in bridge br-int Oct 09 01:06:07.288816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:06:07.289115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['7de0dd97-55b5-4e6a-820d-3c84d30f92c4'] Oct 09 01:06:07.289986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 7de0dd97-55b5-4e6a-820d-3c84d30f92c4 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:06:07.292594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:546 - port information retrieved. Elapsed:0.013 Oct 09 01:06:07.293131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:546 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 09 01:06:07.497117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:06:07.497501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.621249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroup deleted: 45da6575-619b-423b-bc04-7f831c564029 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.621831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (45da6575-619b-423b-bc04-7f831c564029), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.622078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('45da6575-619b-423b-bc04-7f831c564029',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:06:08.636165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('45da6575-619b-423b-bc04-7f831c564029',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:06:08.636616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroupRule deleted: b23da15f-5d69-4f41-be0a-c96a3e48baae {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.637004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b23da15f-5d69-4f41-be0a-c96a3e48baae), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.637353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 01:06:08.637934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroupRule deleted: de4f58ee-209d-48d6-a3f0-109a2f5cb550 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.638281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (de4f58ee-209d-48d6-a3f0-109a2f5cb550), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.638618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 01:06:08.639106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroupRule deleted: f3df4d8c-5f21-488a-a1e5-cf490baf7401 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.639794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (f3df4d8c-5f21-488a-a1e5-cf490baf7401), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.640139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 01:06:08.640503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroupRule deleted: 47033289-16c5-4d4d-9760-1b4d0b7428a4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.640856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (47033289-16c5-4d4d-9760-1b4d0b7428a4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.641162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 01:06:08.641527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroupRule deleted: 767e9ff3-870f-4b46-a7c1-deabf3861797 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.641877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (767e9ff3-870f-4b46-a7c1-deabf3861797), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.642185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 01:06:08.643079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroupRule deleted: 59becfc4-1d9d-4a58-86a7-2a135ae48fff {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.643079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (59becfc4-1d9d-4a58-86a7-2a135ae48fff), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.643286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 01:06:08.643540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroupRule deleted: 5c87d8c0-b4b3-4ff8-9320-02ea542ff7f6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.645004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5c87d8c0-b4b3-4ff8-9320-02ea542ff7f6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.645500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 01:06:08.646020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Resource SecurityGroupRule deleted: 8dbd829f-87b0-47b9-9561-69a5a19f9253 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:08.646528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (8dbd829f-87b0-47b9-9561-69a5a19f9253), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:08.647004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f4fda001-bec6-4645-a101-1c69904524da tempest-TestVolumeBootPattern-121914356 tempest-TestVolumeBootPattern-121914356-project] Security group rule updated ['45da6575-619b-423b-bc04-7f831c564029'] Oct 09 01:06:09.281300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:547 started Oct 09 01:06:09.283682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=605000000,duration_sec=1111,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:09.284201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:09.284539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:547 - starting polling. Elapsed:0.003 Oct 09 01:06:09.286574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:09.289168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:547 - port information retrieved. Elapsed:0.008 Oct 09 01:06:09.289539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:547 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:06:09.387445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:06:09.387951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:09.788674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b096e030-2f18-4e25-ac22-80dbb615838c admin admin] Resource Port deleted: 546af4ee-57b8-4aab-a465-e176e85a3fa1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:09.789294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b096e030-2f18-4e25-ac22-80dbb615838c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (546af4ee-57b8-4aab-a465-e176e85a3fa1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:11.062651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["264293d2-2162-46df-97e5-63583e37003b","delete","qr-546af4ee-57",21,["map",[["attached-mac","fa:16:3e:34:60:04"],["iface-id","546af4ee-57b8-4aab-a465-e176e85a3fa1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:11.107722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e2911d2f-1a6e-434b-8614-d2b98cf53940 admin admin] Resource Port deleted: fb7aab07-c773-45fb-ab7c-b325d1a9f4ef {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:11.108201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e2911d2f-1a6e-434b-8614-d2b98cf53940 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (fb7aab07-c773-45fb-ab7c-b325d1a9f4ef), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:11.281873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:548 started Oct 09 01:06:11.366750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=687000000,duration_sec=1113,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:11.368593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:11.369181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:548 - starting polling. Elapsed:0.087 Oct 09 01:06:11.371271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:11.380711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fb7aab07-c7, col_values=(('tag', 4095),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:06:11.404608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0de,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:11.405018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'] Oct 09 01:06:11.405466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:06:11.458093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b48f55-7d66-4659-abde-f37f53aac847]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:06:11.463925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0e0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:11.464555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:548 - port information retrieved. Elapsed:0.183 Oct 09 01:06:11.465113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'e117ae0c-3834-457d-833e-82227f33c129', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef', '8909d97f-c5e3-462a-9bad-225ac2909771', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'546af4ee-57b8-4aab-a465-e176e85a3fa1'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:06:11.465672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:548 - agent port security group processed in 0.000 Oct 09 01:06:11.467649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:06:11.468197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'546af4ee-57b8-4aab-a465-e176e85a3fa1'} Oct 09 01:06:11.468859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:06:11.506575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8cb39c29-7f62-45fd-8af6-ca7ee8d7354a","delete","qg-fb7aab07-c7",19,["map",[["attached-mac","fa:16:3e:14:05:b1"],["iface-id","fb7aab07-c773-45fb-ab7c-b325d1a9f4ef"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:11.712422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-90c7fc9f-d171-4487-acc8-25eb31f2cd99 admin admin] Resource Subnet deleted: d7f3cba3-1b89-4cb1-b9ef-80793ce54a94 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:11.712798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-90c7fc9f-d171-4487-acc8-25eb31f2cd99 admin admin] Publish callbacks [] for Subnet (d7f3cba3-1b89-4cb1-b9ef-80793ce54a94), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:11.840492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb1613a-c226-4128-b2fb-509ebf126897]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:06:11.841153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'546af4ee-57b8-4aab-a465-e176e85a3fa1'} removed Oct 09 01:06:11.859967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aec66d75-098f-4180-9fa8-1cbe08f6c2af","delete","tape117ae0c-38",18,["map",[["attached-mac","fa:16:3e:bc:0d:c2"],["iface-id","e117ae0c-3834-457d-833e-82227f33c129"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:11.876205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:06:11.876630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:548 - treat_devices_removed completed in 0.408 Oct 09 01:06:11.876918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:548 - ports processed. Elapsed:0.595 Oct 09 01:06:11.877275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:548 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.596 Oct 09 01:06:12.040055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-da3a37ff-1d49-454c-8df9-ac5709db84fb admin admin] Resource Port deleted: e117ae0c-3834-457d-833e-82227f33c129 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:12.040549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-da3a37ff-1d49-454c-8df9-ac5709db84fb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (e117ae0c-3834-457d-833e-82227f33c129), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:12.137509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2dfbef96-3931-4f6b-a53c-483989fb8a51 None None] Resource Port deleted: e117ae0c-3834-457d-833e-82227f33c129 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:12.138121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-2dfbef96-3931-4f6b-a53c-483989fb8a51 None None] Skipped duplicate delete event for e117ae0c-3834-457d-833e-82227f33c129 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 09 01:06:12.281917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-da3a37ff-1d49-454c-8df9-ac5709db84fb admin admin] Resource Network deleted: 51f66c80-6e94-4ac9-ad00-6dd9246260d1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:12.282288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-da3a37ff-1d49-454c-8df9-ac5709db84fb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (51f66c80-6e94-4ac9-ad00-6dd9246260d1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:13.282916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:549 started Oct 09 01:06:13.285808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=607000000,duration_sec=1115,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:13.286448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:13.286936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:549 - starting polling. Elapsed:0.004 Oct 09 01:06:13.288818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:13.292968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0e4,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:13.294814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0e6,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:13.295126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:549 - port information retrieved. Elapsed:0.012 Oct 09 01:06:13.295455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', '8909d97f-c5e3-462a-9bad-225ac2909771', '694ef31e-6f15-4593-9990-eb27b05a49e8', '4c3a97ee-facb-4248-818b-3d6676479188', '79dc7d7f-004a-4e23-b50f-7ca413583909', 'a976c1aa-1777-4766-a2b3-029491ee66f7', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'added': set(), 'removed': {'e117ae0c-3834-457d-833e-82227f33c129', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:06:13.295812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:549 - agent port security group processed in 0.000 Oct 09 01:06:13.297314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:06:13.297612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'e117ae0c-3834-457d-833e-82227f33c129', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'} Oct 09 01:06:13.298001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port fb7aab07-c773-45fb-ab7c-b325d1a9f4ef is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:06:13.298361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:06:13.337090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[7143a9c7-6e12-449f-81f0-26f3c4c2aad5]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:06:13.337675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'e117ae0c-3834-457d-833e-82227f33c129', 'fb7aab07-c773-45fb-ab7c-b325d1a9f4ef'} removed Oct 09 01:06:13.383215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:06:13.383955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 8 from net-id = 51f66c80-6e94-4ac9-ad00-6dd9246260d1, seg-id = 681 Oct 09 01:06:13.386573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da1845,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:13.389655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363f0e8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4777}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:13.390078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:06:13.390463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:549 - treat_devices_removed completed in 0.093 Oct 09 01:06:13.390817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:549 - ports processed. Elapsed:0.108 Oct 09 01:06:13.391365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:549 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.109 Oct 09 01:06:13.411037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-837d2f91-cd0e-4fab-bacf-40c57780c38d admin admin] Resource Port deleted: 694ef31e-6f15-4593-9990-eb27b05a49e8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:13.411487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-837d2f91-cd0e-4fab-bacf-40c57780c38d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (694ef31e-6f15-4593-9990-eb27b05a49e8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:14.402564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["985271c0-7ad9-429f-8c1c-ec6b6f470afc","delete","qr-694ef31e-6f",22,["map",[["attached-mac","fa:16:3e:d3:3f:32"],["iface-id","694ef31e-6f15-4593-9990-eb27b05a49e8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:14.433036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-256869d8-b5a8-47e0-aa01-1667b88cce3a admin admin] Resource Port deleted: a642f240-21a3-4c54-8d26-c38ff0409d76 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:14.433490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-256869d8-b5a8-47e0-aa01-1667b88cce3a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (a642f240-21a3-4c54-8d26-c38ff0409d76), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:14.788249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["019b1241-d5aa-4254-9407-ddd2c0c0849f","delete","qg-a642f240-21",23,["map",[["attached-mac","fa:16:3e:0f:65:3e"],["iface-id","a642f240-21a3-4c54-8d26-c38ff0409d76"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:14.873668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-58120470-0bdf-478d-ae55-738a8cb7e036 admin admin] Resource Subnet deleted: 3b0167a8-9316-47c8-b78a-93b4c6f720b5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:14.874148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-58120470-0bdf-478d-ae55-738a8cb7e036 admin admin] Publish callbacks [] for Subnet (3b0167a8-9316-47c8-b78a-93b4c6f720b5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:14.995498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4deb8e2a-26b1-4ce4-b668-9a0d8227a803","delete","tap79dc7d7f-00",20,["map",[["attached-mac","fa:16:3e:e4:bc:c1"],["iface-id","79dc7d7f-004a-4e23-b50f-7ca413583909"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:15.184662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e9b61836-d0d6-4232-8d32-52af84d26007 admin admin] Resource Port deleted: 79dc7d7f-004a-4e23-b50f-7ca413583909 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:15.185049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e9b61836-d0d6-4232-8d32-52af84d26007 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (79dc7d7f-004a-4e23-b50f-7ca413583909), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:15.283373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:550 started Oct 09 01:06:15.286567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=607000000,duration_sec=1117,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:15.287341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:15.287948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:550 - starting polling. Elapsed:0.005 Oct 09 01:06:15.290590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:15.294947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0ec,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:15.300793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0ee,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:15.305688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f0f0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:15.306189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:550 - port information retrieved. Elapsed:0.023 Oct 09 01:06:15.306700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', '8909d97f-c5e3-462a-9bad-225ac2909771', '4c3a97ee-facb-4248-818b-3d6676479188', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': {'79dc7d7f-004a-4e23-b50f-7ca413583909', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'a642f240-21a3-4c54-8d26-c38ff0409d76'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:06:15.307206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:550 - agent port security group processed in 0.000 Oct 09 01:06:15.312142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:06:15.312473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'79dc7d7f-004a-4e23-b50f-7ca413583909', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'a642f240-21a3-4c54-8d26-c38ff0409d76'} Oct 09 01:06:15.313035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 12 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:06:15.371935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3acf4adb-d401-4c0f-a63a-01be133cbe54 None None] Resource Port deleted: 79dc7d7f-004a-4e23-b50f-7ca413583909 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:15.372524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3acf4adb-d401-4c0f-a63a-01be133cbe54 None None] Skipped duplicate delete event for 79dc7d7f-004a-4e23-b50f-7ca413583909 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 09 01:06:15.380053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdaee1f-baf0-4caf-8bc7-b65aa07f4645]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:06:15.382951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'79dc7d7f-004a-4e23-b50f-7ca413583909', '694ef31e-6f15-4593-9990-eb27b05a49e8', 'a642f240-21a3-4c54-8d26-c38ff0409d76'} removed Oct 09 01:06:15.465341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:06:15.465896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 9 from net-id = db7e2df3-cfef-4dc0-bfd4-74237b8cf94f, seg-id = 687 Oct 09 01:06:15.469239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e9b61836-d0d6-4232-8d32-52af84d26007 admin admin] Resource Network deleted: db7e2df3-cfef-4dc0-bfd4-74237b8cf94f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:15.469618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e9b61836-d0d6-4232-8d32-52af84d26007 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (db7e2df3-cfef-4dc0-bfd4-74237b8cf94f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:15.472191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da1847,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:15.474516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363f0f2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4783}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:15.475362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:550 - treat_devices_removed completed in 0.163 Oct 09 01:06:15.475849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:550 - ports processed. Elapsed:0.193 Oct 09 01:06:15.476362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:550 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.193 Oct 09 01:06:15.744258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Resource SecurityGroup deleted: efe8e641-d0f7-40f4-b7d8-d8c3916e70eb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:15.744722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (efe8e641-d0f7-40f4-b7d8-d8c3916e70eb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:15.745082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('efe8e641-d0f7-40f4-b7d8-d8c3916e70eb',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:06:15.761923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('efe8e641-d0f7-40f4-b7d8-d8c3916e70eb',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:06:15.762595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Resource SecurityGroupRule deleted: 41a168ef-31b5-44fa-bcc8-1e3ff1f7133d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:15.762963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (41a168ef-31b5-44fa-bcc8-1e3ff1f7133d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:15.763296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Security group rule updated ['efe8e641-d0f7-40f4-b7d8-d8c3916e70eb'] Oct 09 01:06:15.763798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Resource SecurityGroupRule deleted: 63f13082-bb6b-467f-bbaf-d79b7b4b835f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:15.764143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (63f13082-bb6b-467f-bbaf-d79b7b4b835f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:15.764644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Security group rule updated ['efe8e641-d0f7-40f4-b7d8-d8c3916e70eb'] Oct 09 01:06:15.765297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Resource SecurityGroupRule deleted: c435a9c8-9d33-4c7b-b43e-c1a4bf6ed1de {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:15.765645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (c435a9c8-9d33-4c7b-b43e-c1a4bf6ed1de), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:15.765964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Security group rule updated ['efe8e641-d0f7-40f4-b7d8-d8c3916e70eb'] Oct 09 01:06:15.766330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Resource SecurityGroupRule deleted: e3748a3d-f613-488a-a340-90f0a49dfc6f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:15.766878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e3748a3d-f613-488a-a340-90f0a49dfc6f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:15.767192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-32d22734-110b-4388-993f-45f48426a514 admin admin] Security group rule updated ['efe8e641-d0f7-40f4-b7d8-d8c3916e70eb'] Oct 09 01:06:16.223453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Resource SecurityGroup deleted: eafb91c1-05f4-4b2f-a40a-859b9fa695a2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:16.223855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (eafb91c1-05f4-4b2f-a40a-859b9fa695a2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:16.224305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('eafb91c1-05f4-4b2f-a40a-859b9fa695a2',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:06:16.236780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('eafb91c1-05f4-4b2f-a40a-859b9fa695a2',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:06:16.237363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Resource SecurityGroupRule deleted: 1ca30ed6-ed39-497e-970d-eb52c1c3f288 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:16.238122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1ca30ed6-ed39-497e-970d-eb52c1c3f288), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:16.238454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Security group rule updated ['eafb91c1-05f4-4b2f-a40a-859b9fa695a2'] Oct 09 01:06:16.238852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Resource SecurityGroupRule deleted: 5be98686-0f71-48b5-b101-e5d7d0319745 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:16.239195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5be98686-0f71-48b5-b101-e5d7d0319745), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:16.239510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Security group rule updated ['eafb91c1-05f4-4b2f-a40a-859b9fa695a2'] Oct 09 01:06:16.239912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Resource SecurityGroupRule deleted: 6d0ce77b-311e-4801-8a7e-5e10735528c7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:16.240248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6d0ce77b-311e-4801-8a7e-5e10735528c7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:16.240561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Security group rule updated ['eafb91c1-05f4-4b2f-a40a-859b9fa695a2'] Oct 09 01:06:16.240926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Resource SecurityGroupRule deleted: e2d72448-632c-4e60-a555-c55b5f7d4191 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:16.241260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e2d72448-632c-4e60-a555-c55b5f7d4191), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:16.241579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-c4ae9e09-fba0-456c-b6b6-c880cce17e26 admin admin] Security group rule updated ['eafb91c1-05f4-4b2f-a40a-859b9fa695a2'] Oct 09 01:06:17.284086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:551 started Oct 09 01:06:17.286429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=607000000,duration_sec=1119,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:17.286998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:17.287352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:551 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:06:19.284869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:552 started Oct 09 01:06:19.287271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=608000000,duration_sec=1121,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:19.287903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:19.288261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:552 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:21.285885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:553 started Oct 09 01:06:21.288241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=609000000,duration_sec=1123,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:21.288798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:21.289144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:553 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:06:23.287231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:554 started Oct 09 01:06:23.289825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=611000000,duration_sec=1125,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:23.290384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:23.290735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:554 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:25.287887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:555 started Oct 09 01:06:25.290802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=611000000,duration_sec=1127,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:25.291486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:25.291859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:555 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:27.288949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:556 started Oct 09 01:06:27.291955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f0fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=613000000,duration_sec=1129,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:27.292557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:27.292906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:556 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:29.290216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:557 started Oct 09 01:06:29.292555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f100,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=614000000,duration_sec=1131,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:29.293114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:29.293468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:557 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:06:31.291477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:558 started Oct 09 01:06:31.293774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f102,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=615000000,duration_sec=1133,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:31.294322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:31.294669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:558 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:06:33.333600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:559 started Oct 09 01:06:33.335835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f104,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=657000000,duration_sec=1135,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:33.336451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:33.336800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:559 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:06:35.335448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:560 started Oct 09 01:06:35.338237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f106,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=659000000,duration_sec=1137,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:35.338796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:35.339142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:560 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:37.336859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:561 started Oct 09 01:06:37.340222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f108,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=661000000,duration_sec=1139,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:37.340786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:37.341135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:561 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:06:39.337194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:562 started Oct 09 01:06:39.339718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f10a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=660000000,duration_sec=1141,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:39.340955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:39.341300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:562 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:41.338450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:563 started Oct 09 01:06:41.341487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f10c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=662000000,duration_sec=1143,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:41.342766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:41.343219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:563 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:06:43.339669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:564 started Oct 09 01:06:43.341918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f10e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=663000000,duration_sec=1145,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:43.342474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:43.342821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:564 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:06:45.340845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:565 started Oct 09 01:06:45.343159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f110,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=664000000,duration_sec=1147,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:45.343766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:45.344117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:565 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:06:46.325530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4bfdfbc3-48b1-440a-b401-44ff583a9f66 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource Port deleted: 41d333d7-a33b-44cc-9e3c-2de2e0120491 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:46.326144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4bfdfbc3-48b1-440a-b401-44ff583a9f66 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (41d333d7-a33b-44cc-9e3c-2de2e0120491), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:46.326826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4bfdfbc3-48b1-440a-b401-44ff583a9f66 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group member updated {'8c40e0ac-a4c8-40aa-9db3-75e4c699d618'} Oct 09 01:06:47.342000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:566 started Oct 09 01:06:47.344863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f112,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=666000000,duration_sec=1149,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:47.345427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:47.345787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:566 - starting polling. Elapsed:0.004 Oct 09 01:06:47.347296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:47.348575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 not present in bridge br-int Oct 09 01:06:47.348907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:06:47.349189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['41d333d7-a33b-44cc-9e3c-2de2e0120491'] Oct 09 01:06:47.349505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 41d333d7-a33b-44cc-9e3c-2de2e0120491 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:06:47.351167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:566 - port information retrieved. Elapsed:0.009 Oct 09 01:06:47.351497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:566 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 09 01:06:47.919211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroup deleted: 8c40e0ac-a4c8-40aa-9db3-75e4c699d618 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:47.919786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (8c40e0ac-a4c8-40aa-9db3-75e4c699d618), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:47.920303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8c40e0ac-a4c8-40aa-9db3-75e4c699d618',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:06:47.932268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8c40e0ac-a4c8-40aa-9db3-75e4c699d618',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:06:47.932675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroupRule deleted: aea72606-ca1e-4f27-8296-0039bc5335eb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:47.933042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (aea72606-ca1e-4f27-8296-0039bc5335eb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:47.933376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['8c40e0ac-a4c8-40aa-9db3-75e4c699d618'] Oct 09 01:06:47.933765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroupRule deleted: d4c9c414-2291-4b13-ae36-ecbb2012dd53 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:47.934110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d4c9c414-2291-4b13-ae36-ecbb2012dd53), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:47.934424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['8c40e0ac-a4c8-40aa-9db3-75e4c699d618'] Oct 09 01:06:47.934790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroupRule deleted: 7685e874-d9bd-4c39-a054-fb3692623717 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:47.935129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (7685e874-d9bd-4c39-a054-fb3692623717), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:47.935443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['8c40e0ac-a4c8-40aa-9db3-75e4c699d618'] Oct 09 01:06:47.935827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource SecurityGroupRule deleted: 3654bf6f-217d-4718-950f-6acada24a843 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:47.936190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3654bf6f-217d-4718-950f-6acada24a843), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:47.936526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-edab7f83-4c83-48cc-a238-bda6cbbde2a3 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Security group rule updated ['8c40e0ac-a4c8-40aa-9db3-75e4c699d618'] Oct 09 01:06:48.273062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5a0c02cf-6593-4c30-af86-fd05ad2a7ac9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Resource Port deleted: 606f5503-a88d-401a-826c-23c0ab125c2e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:48.274386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5a0c02cf-6593-4c30-af86-fd05ad2a7ac9 tempest-AttachVolumeShelveTestJSON-260510153 tempest-AttachVolumeShelveTestJSON-260510153-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (606f5503-a88d-401a-826c-23c0ab125c2e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:49.344147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:567 started Oct 09 01:06:49.346601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f114,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=668000000,duration_sec=1151,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:49.347156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:49.347489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:567 - starting polling. Elapsed:0.004 Oct 09 01:06:49.349071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:49.350050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 606f5503-a88d-401a-826c-23c0ab125c2e not present in bridge br-int Oct 09 01:06:49.350371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:06:49.350648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['606f5503-a88d-401a-826c-23c0ab125c2e'] Oct 09 01:06:49.350963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 606f5503-a88d-401a-826c-23c0ab125c2e is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:06:49.352644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:567 - port information retrieved. Elapsed:0.009 Oct 09 01:06:49.352966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:567 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 01:06:51.345373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:568 started Oct 09 01:06:51.348146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f116,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=669000000,duration_sec=1153,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:51.348720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:51.349075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:568 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:51.970369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c15002c9-ccca-42ed-a50e-e7600c6b7403 admin admin] Resource Port deleted: 4c3a97ee-facb-4248-818b-3d6676479188 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:51.970750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c15002c9-ccca-42ed-a50e-e7600c6b7403 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (4c3a97ee-facb-4248-818b-3d6676479188), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:52.943059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["911a00f8-37a9-45d8-8762-bd80acb50a8c","delete","qr-4c3a97ee-fa",25,["map",[["attached-mac","fa:16:3e:7c:db:ac"],["iface-id","4c3a97ee-facb-4248-818b-3d6676479188"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:52.978997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-84354769-8313-4587-bedb-7d915d589641 admin admin] Resource Port deleted: bd00ba1d-bc1e-47c3-987d-b5e22a6cc264 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:52.979386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-84354769-8313-4587-bedb-7d915d589641 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (bd00ba1d-bc1e-47c3-987d-b5e22a6cc264), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:53.319404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["db03cce3-70f6-4763-82d0-25dd4977f357","delete","qg-bd00ba1d-bc",26,["map",[["attached-mac","fa:16:3e:b3:01:1f"],["iface-id","bd00ba1d-bc1e-47c3-987d-b5e22a6cc264"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:53.345677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:569 started Oct 09 01:06:53.423829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c811ff84-5a5e-4d9f-9c56-3fa9b008bafb admin admin] Resource Subnet deleted: 2363adb4-e3f9-485c-a97a-228855e865bf {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:53.424395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c811ff84-5a5e-4d9f-9c56-3fa9b008bafb admin admin] Publish callbacks [] for Subnet (2363adb4-e3f9-485c-a97a-228855e865bf), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:53.542758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["471a03f9-b1e4-4a67-95c1-5438c820ac5e","delete","tapf3dc5370-39",24,["map",[["attached-mac","fa:16:3e:c8:af:85"],["iface-id","f3dc5370-39c5-4415-92ad-c8dc6c6bb65b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:06:53.607304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f118,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=927000000,duration_sec=1155,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:53.607970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:53.608408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:569 - starting polling. Elapsed:0.263 Oct 09 01:06:53.610887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:53.638954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f11a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:53.642608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f11c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:53.644444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f11e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:53.644759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:569 - port information retrieved. Elapsed:0.299 Oct 09 01:06:53.645098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', '4c3a97ee-facb-4248-818b-3d6676479188', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:06:53.645396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:569 - agent port security group processed in 0.000 Oct 09 01:06:53.646428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:06:53.647736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', '4c3a97ee-facb-4248-818b-3d6676479188', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264'} Oct 09 01:06:53.647736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 12 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:06:53.687697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[d026fc90-2196-43b6-88df-0551ebc8e03c]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:06:53.688797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'f3dc5370-39c5-4415-92ad-c8dc6c6bb65b', '4c3a97ee-facb-4248-818b-3d6676479188', 'bd00ba1d-bc1e-47c3-987d-b5e22a6cc264'} removed Oct 09 01:06:53.737992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fffec0ed-4cee-41bb-a510-fab9325bc3e7 admin admin] Resource Port deleted: f3dc5370-39c5-4415-92ad-c8dc6c6bb65b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:53.738584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fffec0ed-4cee-41bb-a510-fab9325bc3e7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (f3dc5370-39c5-4415-92ad-c8dc6c6bb65b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:53.842347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:06:53.842825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 10 from net-id = d442b64f-563d-410a-8314-ec0e04e8ccd0, seg-id = 655 Oct 09 01:06:53.845529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da1849,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:53.847772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363f120,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4751}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:53.848326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:569 - treat_devices_removed completed in 0.202 Oct 09 01:06:53.848619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:569 - ports processed. Elapsed:0.503 Oct 09 01:06:53.849129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:569 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.504 Oct 09 01:06:53.924583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-22f72676-fc32-4aff-8de2-fdb5ab74b386 None None] Resource Port deleted: f3dc5370-39c5-4415-92ad-c8dc6c6bb65b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:53.924583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-22f72676-fc32-4aff-8de2-fdb5ab74b386 None None] Skipped duplicate delete event for f3dc5370-39c5-4415-92ad-c8dc6c6bb65b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 09 01:06:54.001484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-fffec0ed-4cee-41bb-a510-fab9325bc3e7 admin admin] Resource Network deleted: d442b64f-563d-410a-8314-ec0e04e8ccd0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:54.002045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-fffec0ed-4cee-41bb-a510-fab9325bc3e7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (d442b64f-563d-410a-8314-ec0e04e8ccd0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:54.276728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Resource SecurityGroup deleted: fe129bf6-63cc-41d3-9163-6b17f0f2383d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:54.277099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (fe129bf6-63cc-41d3-9163-6b17f0f2383d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:54.277600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fe129bf6-63cc-41d3-9163-6b17f0f2383d',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:06:54.291659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fe129bf6-63cc-41d3-9163-6b17f0f2383d',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:06:54.292054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Resource SecurityGroupRule deleted: 3fcfc8b5-68c0-407c-ba98-52aee2067692 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:54.292916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3fcfc8b5-68c0-407c-ba98-52aee2067692), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:54.293251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Security group rule updated ['fe129bf6-63cc-41d3-9163-6b17f0f2383d'] Oct 09 01:06:54.293829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Resource SecurityGroupRule deleted: d00d85b3-3493-4ced-b42e-8aa289955759 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:54.294342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d00d85b3-3493-4ced-b42e-8aa289955759), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:54.294662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Security group rule updated ['fe129bf6-63cc-41d3-9163-6b17f0f2383d'] Oct 09 01:06:54.295030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Resource SecurityGroupRule deleted: d27b09b6-15a9-484c-9826-2c1972aaacd3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:54.295386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d27b09b6-15a9-484c-9826-2c1972aaacd3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:54.295727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Security group rule updated ['fe129bf6-63cc-41d3-9163-6b17f0f2383d'] Oct 09 01:06:54.296089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Resource SecurityGroupRule deleted: e0ddc489-5e38-47f7-b70d-e19305e7dcec {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:54.296419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (e0ddc489-5e38-47f7-b70d-e19305e7dcec), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:54.296827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-9cc8e072-9af5-412c-abcf-ec686cd9ed41 admin admin] Security group rule updated ['fe129bf6-63cc-41d3-9163-6b17f0f2383d'] Oct 09 01:06:55.346997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:570 started Oct 09 01:06:55.349402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f122,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=670000000,duration_sec=1157,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:55.349987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:55.350317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:570 - starting polling. Elapsed:0.004 Oct 09 01:06:55.351576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:55.352419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f3dc5370-39c5-4415-92ad-c8dc6c6bb65b not present in bridge br-int Oct 09 01:06:55.352742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:06:55.353311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['f3dc5370-39c5-4415-92ad-c8dc6c6bb65b'] Oct 09 01:06:55.353426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f3dc5370-39c5-4415-92ad-c8dc6c6bb65b is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:06:55.354583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:570 - port information retrieved. Elapsed:0.008 Oct 09 01:06:55.354905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:570 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:06:56.435809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:06:56Z,description='Default security group',id=3a42f533-acc6-4801-86e5-7be1cd08ab79,is_default=True,name='default',project_id='26f33282f4974f2580c0174fa49ba422',revision_number=1,rules=[SecurityGroupRule(02f6dc38-c4fc-4086-b567-c1980727a1e4),SecurityGroupRule(9d6593fc-8347-4ddc-b94d-c5b5ba5808fd),SecurityGroupRule(cddb1f0e-469c-4381-b368-755f8373362d),SecurityGroupRule(d7a93e07-0eb2-4cb4-84c7-014a9024523f)],shared=False,stateful=True,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.436405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (3a42f533-acc6-4801-86e5-7be1cd08ab79), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.436802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:56Z,description=,direction='ingress',ethertype='IPv6',id=02f6dc38-c4fc-4086-b567-c1980727a1e4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='26f33282f4974f2580c0174fa49ba422',protocol=,remote_address_group_id=,remote_group_id=3a42f533-acc6-4801-86e5-7be1cd08ab79,remote_ip_prefix=,revision_number=0,security_group_id=3a42f533-acc6-4801-86e5-7be1cd08ab79,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.437157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (02f6dc38-c4fc-4086-b567-c1980727a1e4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.437491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Security group rule updated ['3a42f533-acc6-4801-86e5-7be1cd08ab79'] Oct 09 01:06:56.438159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:56Z,description=,direction='egress',ethertype='IPv4',id=9d6593fc-8347-4ddc-b94d-c5b5ba5808fd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='26f33282f4974f2580c0174fa49ba422',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3a42f533-acc6-4801-86e5-7be1cd08ab79,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.438510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9d6593fc-8347-4ddc-b94d-c5b5ba5808fd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.438836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Security group rule updated ['3a42f533-acc6-4801-86e5-7be1cd08ab79'] Oct 09 01:06:56.439481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:56Z,description=,direction='egress',ethertype='IPv6',id=cddb1f0e-469c-4381-b368-755f8373362d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='26f33282f4974f2580c0174fa49ba422',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3a42f533-acc6-4801-86e5-7be1cd08ab79,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.439898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (cddb1f0e-469c-4381-b368-755f8373362d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.440259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Security group rule updated ['3a42f533-acc6-4801-86e5-7be1cd08ab79'] Oct 09 01:06:56.440908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:56Z,description=,direction='ingress',ethertype='IPv4',id=d7a93e07-0eb2-4cb4-84c7-014a9024523f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='26f33282f4974f2580c0174fa49ba422',protocol=,remote_address_group_id=,remote_group_id=3a42f533-acc6-4801-86e5-7be1cd08ab79,remote_ip_prefix=,revision_number=0,security_group_id=3a42f533-acc6-4801-86e5-7be1cd08ab79,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.441261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d7a93e07-0eb2-4cb4-84c7-014a9024523f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.441583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-5c1dd4f3-571b-40be-85cf-7674da27e98c admin admin] Security group rule updated ['3a42f533-acc6-4801-86e5-7be1cd08ab79'] Oct 09 01:06:56.564324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Resource SecurityGroup deleted: 3a42f533-acc6-4801-86e5-7be1cd08ab79 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:56.564797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (3a42f533-acc6-4801-86e5-7be1cd08ab79), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.565317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3a42f533-acc6-4801-86e5-7be1cd08ab79',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:06:56.578613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3a42f533-acc6-4801-86e5-7be1cd08ab79',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:06:56.579142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Resource SecurityGroupRule deleted: 02f6dc38-c4fc-4086-b567-c1980727a1e4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:56.579568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (02f6dc38-c4fc-4086-b567-c1980727a1e4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.580020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Security group rule updated ['3a42f533-acc6-4801-86e5-7be1cd08ab79'] Oct 09 01:06:56.580464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Resource SecurityGroupRule deleted: 9d6593fc-8347-4ddc-b94d-c5b5ba5808fd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:56.580897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9d6593fc-8347-4ddc-b94d-c5b5ba5808fd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.581310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Security group rule updated ['3a42f533-acc6-4801-86e5-7be1cd08ab79'] Oct 09 01:06:56.581787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Resource SecurityGroupRule deleted: cddb1f0e-469c-4381-b368-755f8373362d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:56.582908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (cddb1f0e-469c-4381-b368-755f8373362d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.583299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Security group rule updated ['3a42f533-acc6-4801-86e5-7be1cd08ab79'] Oct 09 01:06:56.584122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Resource SecurityGroupRule deleted: d7a93e07-0eb2-4cb4-84c7-014a9024523f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:56.584122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d7a93e07-0eb2-4cb4-84c7-014a9024523f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.584621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-0bd34515-07ce-4d63-9c51-0fe5af285bd6 admin admin] Security group rule updated ['3a42f533-acc6-4801-86e5-7be1cd08ab79'] Oct 09 01:06:56.949658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:06:56Z,description='Default security group',id=3609d133-6689-4063-a609-8b5360becc97,is_default=True,name='default',project_id='d6b4b6ece1084307b8c102eeaacd1812',revision_number=1,rules=[SecurityGroupRule(55099f6f-a353-400d-ba4e-81749d72e40a),SecurityGroupRule(9b1e46e0-ace3-42b3-8753-25b502c352b7),SecurityGroupRule(d4d4b9b8-f0b6-4c0e-a244-9af44a8bb1b4),SecurityGroupRule(fca7501b-e285-4464-bf1c-096dc531fef6)],shared=False,stateful=True,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.950034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (3609d133-6689-4063-a609-8b5360becc97), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.950767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:56Z,description=,direction='egress',ethertype='IPv6',id=55099f6f-a353-400d-ba4e-81749d72e40a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6b4b6ece1084307b8c102eeaacd1812',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3609d133-6689-4063-a609-8b5360becc97,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.951128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (55099f6f-a353-400d-ba4e-81749d72e40a), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.951464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Security group rule updated ['3609d133-6689-4063-a609-8b5360becc97'] Oct 09 01:06:56.952167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:56Z,description=,direction='ingress',ethertype='IPv4',id=9b1e46e0-ace3-42b3-8753-25b502c352b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6b4b6ece1084307b8c102eeaacd1812',protocol=,remote_address_group_id=,remote_group_id=3609d133-6689-4063-a609-8b5360becc97,remote_ip_prefix=,revision_number=0,security_group_id=3609d133-6689-4063-a609-8b5360becc97,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.952948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (9b1e46e0-ace3-42b3-8753-25b502c352b7), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.952948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Security group rule updated ['3609d133-6689-4063-a609-8b5360becc97'] Oct 09 01:06:56.953505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:56Z,description=,direction='egress',ethertype='IPv4',id=d4d4b9b8-f0b6-4c0e-a244-9af44a8bb1b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6b4b6ece1084307b8c102eeaacd1812',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3609d133-6689-4063-a609-8b5360becc97,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.953856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d4d4b9b8-f0b6-4c0e-a244-9af44a8bb1b4), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.954178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Security group rule updated ['3609d133-6689-4063-a609-8b5360becc97'] Oct 09 01:06:56.954843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:56Z,description=,direction='ingress',ethertype='IPv6',id=fca7501b-e285-4464-bf1c-096dc531fef6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6b4b6ece1084307b8c102eeaacd1812',protocol=,remote_address_group_id=,remote_group_id=3609d133-6689-4063-a609-8b5360becc97,remote_ip_prefix=,revision_number=0,security_group_id=3609d133-6689-4063-a609-8b5360becc97,updated_at=2022-10-09T01:06:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:56.955173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fca7501b-e285-4464-bf1c-096dc531fef6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:56.955491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f460917e-8219-4d2a-a5d1-e453d2029ca9 admin admin] Security group rule updated ['3609d133-6689-4063-a609-8b5360becc97'] Oct 09 01:06:57.085327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Resource SecurityGroup deleted: 3609d133-6689-4063-a609-8b5360becc97 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:57.085327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (3609d133-6689-4063-a609-8b5360becc97), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.086609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3609d133-6689-4063-a609-8b5360becc97',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:06:57.099645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3609d133-6689-4063-a609-8b5360becc97',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:06:57.100140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Resource SecurityGroupRule deleted: 55099f6f-a353-400d-ba4e-81749d72e40a {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:57.100504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (55099f6f-a353-400d-ba4e-81749d72e40a), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.100831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Security group rule updated ['3609d133-6689-4063-a609-8b5360becc97'] Oct 09 01:06:57.101247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Resource SecurityGroupRule deleted: 9b1e46e0-ace3-42b3-8753-25b502c352b7 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:57.102284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (9b1e46e0-ace3-42b3-8753-25b502c352b7), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.102707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Security group rule updated ['3609d133-6689-4063-a609-8b5360becc97'] Oct 09 01:06:57.103079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Resource SecurityGroupRule deleted: d4d4b9b8-f0b6-4c0e-a244-9af44a8bb1b4 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:57.103425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d4d4b9b8-f0b6-4c0e-a244-9af44a8bb1b4), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.103759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Security group rule updated ['3609d133-6689-4063-a609-8b5360becc97'] Oct 09 01:06:57.104122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Resource SecurityGroupRule deleted: fca7501b-e285-4464-bf1c-096dc531fef6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:06:57.104459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fca7501b-e285-4464-bf1c-096dc531fef6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.104768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f1566f12-7be0-4728-9d9f-33fd4d029f2b admin admin] Security group rule updated ['3609d133-6689-4063-a609-8b5360becc97'] Oct 09 01:06:57.347453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:571 started Oct 09 01:06:57.349929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f124,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=671000000,duration_sec=1159,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:57.350907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:57.351299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:571 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:06:57.993127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:06:57Z,description='Default security group',id=ddd5a713-4487-427c-9f3e-9665d0c35a75,is_default=True,name='default',project_id='eca3b6a4954f446c872e43cb98c99528',revision_number=1,rules=[SecurityGroupRule(70000fa4-f1de-45bd-93e1-4b1a510b8643),SecurityGroupRule(74402a7f-c36b-4979-8de2-320789991ca3),SecurityGroupRule(782ea946-01f0-4551-bca2-24d76979a8cb),SecurityGroupRule(85e78850-3e7d-4531-8bb2-6fa7f8a0a6b0)],shared=False,stateful=True,updated_at=2022-10-09T01:06:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:57.993766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (ddd5a713-4487-427c-9f3e-9665d0c35a75), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.994129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:57Z,description=,direction='egress',ethertype='IPv6',id=70000fa4-f1de-45bd-93e1-4b1a510b8643,normalized_cidr=None,port_range_max=,port_range_min=,project_id='eca3b6a4954f446c872e43cb98c99528',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ddd5a713-4487-427c-9f3e-9665d0c35a75,updated_at=2022-10-09T01:06:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:57.994518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (70000fa4-f1de-45bd-93e1-4b1a510b8643), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.994857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Security group rule updated ['ddd5a713-4487-427c-9f3e-9665d0c35a75'] Oct 09 01:06:57.995566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:57Z,description=,direction='ingress',ethertype='IPv6',id=74402a7f-c36b-4979-8de2-320789991ca3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='eca3b6a4954f446c872e43cb98c99528',protocol=,remote_address_group_id=,remote_group_id=ddd5a713-4487-427c-9f3e-9665d0c35a75,remote_ip_prefix=,revision_number=0,security_group_id=ddd5a713-4487-427c-9f3e-9665d0c35a75,updated_at=2022-10-09T01:06:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:57.995956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (74402a7f-c36b-4979-8de2-320789991ca3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.996272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Security group rule updated ['ddd5a713-4487-427c-9f3e-9665d0c35a75'] Oct 09 01:06:57.996933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:57Z,description=,direction='ingress',ethertype='IPv4',id=782ea946-01f0-4551-bca2-24d76979a8cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='eca3b6a4954f446c872e43cb98c99528',protocol=,remote_address_group_id=,remote_group_id=ddd5a713-4487-427c-9f3e-9665d0c35a75,remote_ip_prefix=,revision_number=0,security_group_id=ddd5a713-4487-427c-9f3e-9665d0c35a75,updated_at=2022-10-09T01:06:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:57.997286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (782ea946-01f0-4551-bca2-24d76979a8cb), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.997725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Security group rule updated ['ddd5a713-4487-427c-9f3e-9665d0c35a75'] Oct 09 01:06:57.998406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:06:57Z,description=,direction='egress',ethertype='IPv4',id=85e78850-3e7d-4531-8bb2-6fa7f8a0a6b0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='eca3b6a4954f446c872e43cb98c99528',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ddd5a713-4487-427c-9f3e-9665d0c35a75,updated_at=2022-10-09T01:06:57Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:57.998783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (85e78850-3e7d-4531-8bb2-6fa7f8a0a6b0), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:57.999139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Security group rule updated ['ddd5a713-4487-427c-9f3e-9665d0c35a75'] Oct 09 01:06:58.135403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T01:06:57Z,description='',dns_domain=None,id=7cd2bff9-2f53-480c-b55a-68a046190b11,mtu=1500,name='tempest-VolumesSnapshotTestJSON-1794040145-network',project_id='eca3b6a4954f446c872e43cb98c99528',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(7cd2bff9-2f53-480c-b55a-68a046190b11),segments=[NetworkSegment(0664c72a-196f-4719-aa05-12245b5ef239)],shared=False,status='ACTIVE',updated_at=2022-10-09T01:06:57Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:58.135873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (7cd2bff9-2f53-480c-b55a-68a046190b11), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-18cfd94f-60cf-45d0-99d5-b4e5fc420d9d admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 7cd2bff9-2f53-480c-b55a-68a046190b11 with segmentation id not found. Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 01:06:58.210197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 01:06:58.212013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 01:06:58.212013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 01:06:58.212013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 01:06:58.212013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 7cd2bff9-2f53-480c-b55a-68a046190b11 with segmentation id not found. Oct 09 01:06:58.212013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 01:06:58.385332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-0873549c-aae9-4d3e-aae6-0fd659aa578a admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(e832ce85-f9f4-4902-8318-3774faf5181e)],cidr=172.20.0.0/28,created_at=2022-10-09T01:06:58Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=31d5d7ea-6c5b-48aa-8d26-cb1a4bd8cc90,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesSnapshotTestJSON-1794040145-subnet',network_id=7cd2bff9-2f53-480c-b55a-68a046190b11,project_id='eca3b6a4954f446c872e43cb98c99528',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T01:06:58Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:06:58.385819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-0873549c-aae9-4d3e-aae6-0fd659aa578a admin admin] Publish callbacks [] for Subnet (31d5d7ea-6c5b-48aa-8d26-cb1a4bd8cc90), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:06:59.348244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:572 started Oct 09 01:06:59.350654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f126,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=672000000,duration_sec=1161,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:06:59.351229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:06:59.351635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:572 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:01.349089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:573 started Oct 09 01:07:01.351462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f128,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=672000000,duration_sec=1163,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:01.352048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:01.352452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:573 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:02.336728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ea49c373-9b1d-48f6-b6a4-a3ebdc922778 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:07:01Z,data_plane_status=None,description='',device_id='2d3659d2-ad76-45be-ab68-eeb1b7edd1cf',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e75a4675-58d6-4e5d-a818-f3569f47570c,mac_address=fa:16:3e:df:94:09,name='',network_id=7cd2bff9-2f53-480c-b55a-68a046190b11,numa_affinity_policy=,project_id='eca3b6a4954f446c872e43cb98c99528',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e75a4675-58d6-4e5d-a818-f3569f47570c),security_group_ids=set([ddd5a713-4487-427c-9f3e-9665d0c35a75]),status='DOWN',updated_at=2022-10-09T01:07:02Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:07:02.337177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ea49c373-9b1d-48f6-b6a4-a3ebdc922778 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e75a4675-58d6-4e5d-a818-f3569f47570c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:02.337724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-ea49c373-9b1d-48f6-b6a4-a3ebdc922778 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Security group member updated {'ddd5a713-4487-427c-9f3e-9665d0c35a75'} Oct 09 01:07:03.130020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c594b7f7-2434-4f5e-9950-f2b00ab48995 service neutron] Resource Port e75a4675-58d6-4e5d-a818-f3569f47570c updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=e75a4675-58d6-4e5d-a818-f3569f47570c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=e75a4675-58d6-4e5d-a818-f3569f47570c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:07:03.130624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c594b7f7-2434-4f5e-9950-f2b00ab48995 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e75a4675-58d6-4e5d-a818-f3569f47570c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:03.350077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:574 started Oct 09 01:07:03.353382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f12a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=674000000,duration_sec=1165,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:03.353960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:03.354366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:574 - starting polling. Elapsed:0.004 Oct 09 01:07:03.355657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:03.358072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:574 - port information retrieved. Elapsed:0.008 Oct 09 01:07:03.359002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:574 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 01:07:03.373311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c594b7f7-2434-4f5e-9950-f2b00ab48995 service neutron] Resource Port e75a4675-58d6-4e5d-a818-f3569f47570c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e75a4675-58d6-4e5d-a818-f3569f47570c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e75a4675-58d6-4e5d-a818-f3569f47570c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e75a4675-58d6-4e5d-a818-f3569f47570c,segment=NetworkSegment(0664c72a-196f-4719-aa05-12245b5ef239),segment_id=0664c72a-196f-4719-aa05-12245b5ef239)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:07:03.373766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c594b7f7-2434-4f5e-9950-f2b00ab48995 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e75a4675-58d6-4e5d-a818-f3569f47570c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:05.352009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:575 started Oct 09 01:07:05.355281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f12c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=676000000,duration_sec=1167,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:05.355883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:05.356211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:575 - starting polling. Elapsed:0.005 Oct 09 01:07:05.357421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:05.358694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:575 - port information retrieved. Elapsed:0.007 Oct 09 01:07:05.359020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:575 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 01:07:07.352900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:576 started Oct 09 01:07:07.355072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f12e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=676000000,duration_sec=1169,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:07.355655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:07.356006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:576 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:07.702168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port e75a4675-58d6-4e5d-a818-f3569f47570c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:07:07.702543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e75a4675-58d6-4e5d-a818-f3569f47570c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:09.354203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:577 started Oct 09 01:07:09.356488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f130,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=677000000,duration_sec=1171,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:09.357041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:09.357366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:577 - starting polling. Elapsed:0.003 Oct 09 01:07:09.358613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:09.359915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:577 - port information retrieved. Elapsed:0.006 Oct 09 01:07:09.360241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:577 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 01:07:09.684834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port e75a4675-58d6-4e5d-a818-f3569f47570c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:07:09.685217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (e75a4675-58d6-4e5d-a818-f3569f47570c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:11.355434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:578 started Oct 09 01:07:11.358541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f132,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=679000000,duration_sec=1173,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:11.359281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:11.359672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:578 - starting polling. Elapsed:0.005 Oct 09 01:07:11.360979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:11.362424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:578 - port information retrieved. Elapsed:0.007 Oct 09 01:07:11.362756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:578 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:07:13.356063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:579 started Oct 09 01:07:13.358471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f134,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=679000000,duration_sec=1175,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:13.359131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:13.359494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:579 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:15.357007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:580 started Oct 09 01:07:15.359373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f136,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=680000000,duration_sec=1177,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:15.359962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:15.360351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:580 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:17.357691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:581 started Oct 09 01:07:17.360334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f138,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=681000000,duration_sec=1179,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:17.360901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:17.361251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:581 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:19.358978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:582 started Oct 09 01:07:19.361762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f13a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=682000000,duration_sec=1181,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:19.362331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:19.362687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:582 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:21.360457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:583 started Oct 09 01:07:21.362965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f13c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=684000000,duration_sec=1183,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:21.363520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:21.363927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:583 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:23.361626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:584 started Oct 09 01:07:23.363988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f13e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=685000000,duration_sec=1185,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:23.364545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:23.364894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:584 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:25.362735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:585 started Oct 09 01:07:25.365303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f140,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=686000000,duration_sec=1187,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:25.365865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:25.366218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:585 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:27.363486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:586 started Oct 09 01:07:27.365877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f142,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=687000000,duration_sec=1189,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:27.366434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:27.366779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:586 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:29.364369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:587 started Oct 09 01:07:29.366725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f144,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=688000000,duration_sec=1191,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:29.367288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:29.367680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:587 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:31.365689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:588 started Oct 09 01:07:31.372615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f146,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=689000000,duration_sec=1193,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:31.373193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:31.373539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:588 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:07:33.367172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:589 started Oct 09 01:07:33.370060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f148,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=690000000,duration_sec=1195,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:33.370618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:33.370966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:589 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:35.368030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:590 started Oct 09 01:07:35.370549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f14a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=691000000,duration_sec=1197,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:35.371137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:35.371486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:590 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:37.369750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:591 started Oct 09 01:07:37.372046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f14c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=693000000,duration_sec=1199,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:37.372613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:37.372963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:591 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:39.370356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:592 started Oct 09 01:07:39.373015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f14e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=694000000,duration_sec=1201,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:39.373581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:39.373935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:592 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:41.370844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:593 started Oct 09 01:07:41.373250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f150,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=694000000,duration_sec=1203,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:41.373807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:41.374158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:593 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:43.372104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:594 started Oct 09 01:07:43.374382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f152,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=695000000,duration_sec=1205,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:43.374945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:43.375294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:594 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:45.373444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:595 started Oct 09 01:07:45.375874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f154,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=697000000,duration_sec=1207,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:45.376567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:45.376925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:595 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:47.374036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:596 started Oct 09 01:07:47.376397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f156,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=697000000,duration_sec=1209,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:47.376955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:47.377304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:596 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:49.374966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:597 started Oct 09 01:07:49.377846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f158,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=699000000,duration_sec=1211,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:49.378391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:49.378742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:597 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:50.925795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-29c74bb7-3048-420e-8eaf-db2c6da48a14 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Resource Port deleted: e75a4675-58d6-4e5d-a818-f3569f47570c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:07:50.926425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-29c74bb7-3048-420e-8eaf-db2c6da48a14 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (e75a4675-58d6-4e5d-a818-f3569f47570c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:50.926577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-29c74bb7-3048-420e-8eaf-db2c6da48a14 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Security group member updated {'ddd5a713-4487-427c-9f3e-9665d0c35a75'} Oct 09 01:07:51.376205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:598 started Oct 09 01:07:51.378533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f15a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=699000000,duration_sec=1213,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:51.379132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:51.379468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:598 - starting polling. Elapsed:0.004 Oct 09 01:07:51.380751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:07:51.381547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e75a4675-58d6-4e5d-a818-f3569f47570c not present in bridge br-int Oct 09 01:07:51.381936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:07:51.382238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['e75a4675-58d6-4e5d-a818-f3569f47570c'] Oct 09 01:07:51.382677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port e75a4675-58d6-4e5d-a818-f3569f47570c is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:07:51.383964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:598 - port information retrieved. Elapsed:0.008 Oct 09 01:07:51.384294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:598 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:07:53.377342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:599 started Oct 09 01:07:53.379635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f15c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=701000000,duration_sec=1215,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:53.380199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:53.380549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:599 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:55.378212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:600 started Oct 09 01:07:55.380603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f15e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=702000000,duration_sec=1217,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:55.381158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:55.381506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:600 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:07:57.379659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:601 started Oct 09 01:07:57.382004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f160,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=703000000,duration_sec=1219,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:57.382594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:57.382947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:601 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:07:59.380440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:602 started Oct 09 01:07:59.382842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f162,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=704000000,duration_sec=1221,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:07:59.383402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:07:59.383787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:602 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:08:01.381603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:603 started Oct 09 01:08:01.384902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f164,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=705000000,duration_sec=1223,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:01.385471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:01.385822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:603 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:02.196613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8f422b9b-8bec-448c-915a-4e8cd23f735d tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:08:01Z,data_plane_status=None,description='',device_id='34b6c397-86fd-4b8c-88b8-6f1c06712aae',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=412074d4-7d44-4fcc-aa1a-123e0303dc5f,mac_address=fa:16:3e:19:69:18,name='',network_id=7cd2bff9-2f53-480c-b55a-68a046190b11,numa_affinity_policy=,project_id='eca3b6a4954f446c872e43cb98c99528',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(412074d4-7d44-4fcc-aa1a-123e0303dc5f),security_group_ids=set([ddd5a713-4487-427c-9f3e-9665d0c35a75]),status='DOWN',updated_at=2022-10-09T01:08:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:02.197040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8f422b9b-8bec-448c-915a-4e8cd23f735d tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (412074d4-7d44-4fcc-aa1a-123e0303dc5f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:02.197535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-8f422b9b-8bec-448c-915a-4e8cd23f735d tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Security group member updated {'ddd5a713-4487-427c-9f3e-9665d0c35a75'} Oct 09 01:08:02.671438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ddeb7b08-f3d3-4719-a701-e699a99cc2f7 service neutron] Resource Port 412074d4-7d44-4fcc-aa1a-123e0303dc5f updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=412074d4-7d44-4fcc-aa1a-123e0303dc5f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=412074d4-7d44-4fcc-aa1a-123e0303dc5f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:02.672015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ddeb7b08-f3d3-4719-a701-e699a99cc2f7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (412074d4-7d44-4fcc-aa1a-123e0303dc5f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:02.948680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ddeb7b08-f3d3-4719-a701-e699a99cc2f7 service neutron] Resource Port 412074d4-7d44-4fcc-aa1a-123e0303dc5f updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=412074d4-7d44-4fcc-aa1a-123e0303dc5f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=412074d4-7d44-4fcc-aa1a-123e0303dc5f,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=412074d4-7d44-4fcc-aa1a-123e0303dc5f,segment=NetworkSegment(0664c72a-196f-4719-aa05-12245b5ef239),segment_id=0664c72a-196f-4719-aa05-12245b5ef239)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:02.949740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ddeb7b08-f3d3-4719-a701-e699a99cc2f7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (412074d4-7d44-4fcc-aa1a-123e0303dc5f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:03.382534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:604 started Oct 09 01:08:03.384968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f166,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=706000000,duration_sec=1225,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:03.385542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:03.385874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:604 - starting polling. Elapsed:0.004 Oct 09 01:08:03.387097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:03.388435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:604 - port information retrieved. Elapsed:0.006 Oct 09 01:08:03.388766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:604 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 01:08:05.383921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:605 started Oct 09 01:08:05.386382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f168,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=707000000,duration_sec=1227,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:05.386879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:05.387234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:605 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:05.960837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 412074d4-7d44-4fcc-aa1a-123e0303dc5f updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:05.961154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (412074d4-7d44-4fcc-aa1a-123e0303dc5f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:07.385342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:606 started Oct 09 01:08:07.387742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f16a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=709000000,duration_sec=1229,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:07.388317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:07.388653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:606 - starting polling. Elapsed:0.004 Oct 09 01:08:07.389882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:07.391169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:606 - port information retrieved. Elapsed:0.006 Oct 09 01:08:07.391506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:606 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 09 01:08:07.966518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Resource Port 412074d4-7d44-4fcc-aa1a-123e0303dc5f updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:07.967389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ddf7cb9-64f5-48f7-8e90-15f5e8dde789 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (412074d4-7d44-4fcc-aa1a-123e0303dc5f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:09.385731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:607 started Oct 09 01:08:09.388614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f16c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=709000000,duration_sec=1231,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:09.389186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:09.389522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:607 - starting polling. Elapsed:0.004 Oct 09 01:08:09.390740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:09.392067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:607 - port information retrieved. Elapsed:0.006 Oct 09 01:08:09.392399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:607 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 09 01:08:11.386902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:608 started Oct 09 01:08:11.389782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f16e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=710000000,duration_sec=1233,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:11.390334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:11.390675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:608 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:13.388519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:609 started Oct 09 01:08:13.390885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f170,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=712000000,duration_sec=1235,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:13.391470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:13.391851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:609 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:15.389505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:610 started Oct 09 01:08:15.391882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f172,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=713000000,duration_sec=1237,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:15.392448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:15.392797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:610 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:08:17.390362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:611 started Oct 09 01:08:17.393014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f174,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=714000000,duration_sec=1239,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:17.393572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:17.393919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:611 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:19.391006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:612 started Oct 09 01:08:19.393297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f176,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=714000000,duration_sec=1241,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:19.393853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:19.394198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:612 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:08:21.392216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:613 started Oct 09 01:08:21.394525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f178,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=715000000,duration_sec=1243,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:21.395081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:21.395429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:613 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:08:23.393031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:614 started Oct 09 01:08:23.395743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f17a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=716000000,duration_sec=1245,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:23.396330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:23.396659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:614 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:25.393876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:615 started Oct 09 01:08:25.396557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f17c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=717000000,duration_sec=1247,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:25.397130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:25.397504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:615 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:27.394820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:616 started Oct 09 01:08:27.397127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f17e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=718000000,duration_sec=1249,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:27.397688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:27.398042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:616 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:29.395705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:617 started Oct 09 01:08:29.398115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f180,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=719000000,duration_sec=1251,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:29.398706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:29.399058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:617 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:31.396465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:618 started Oct 09 01:08:31.398940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f182,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=720000000,duration_sec=1253,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:31.399614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:31.399981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:618 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:31.416026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b020f47a-8a92-41a8-8537-113178edd8d7 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Resource Port deleted: 412074d4-7d44-4fcc-aa1a-123e0303dc5f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:08:31.416405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b020f47a-8a92-41a8-8537-113178edd8d7 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (412074d4-7d44-4fcc-aa1a-123e0303dc5f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:31.416807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b020f47a-8a92-41a8-8537-113178edd8d7 tempest-VolumesSnapshotTestJSON-732559821 tempest-VolumesSnapshotTestJSON-732559821-project] Security group member updated {'ddd5a713-4487-427c-9f3e-9665d0c35a75'} Oct 09 01:08:33.398011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:619 started Oct 09 01:08:33.400774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f184,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=722000000,duration_sec=1255,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:33.401337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:33.401675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:619 - starting polling. Elapsed:0.004 Oct 09 01:08:33.402900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:33.403721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 412074d4-7d44-4fcc-aa1a-123e0303dc5f not present in bridge br-int Oct 09 01:08:33.404050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:08:33.404836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['412074d4-7d44-4fcc-aa1a-123e0303dc5f'] Oct 09 01:08:33.405153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 412074d4-7d44-4fcc-aa1a-123e0303dc5f is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:08:33.406677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:619 - port information retrieved. Elapsed:0.009 Oct 09 01:08:33.407033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:619 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 01:08:35.399311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:620 started Oct 09 01:08:35.401609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f186,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=723000000,duration_sec=1257,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:35.402172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:35.402524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:620 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:08:37.400866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:621 started Oct 09 01:08:37.403710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f188,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=724000000,duration_sec=1259,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:37.404342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:37.404854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:621 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:39.401398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:622 started Oct 09 01:08:39.404598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f18a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=725000000,duration_sec=1261,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:39.405162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:39.405510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:622 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:41.401947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:623 started Oct 09 01:08:41.404335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f18c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=725000000,duration_sec=1263,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:41.404886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:41.405233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:623 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:08:43.403390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:624 started Oct 09 01:08:43.406386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f18e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=727000000,duration_sec=1265,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:43.406943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:43.407294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:624 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:45.405038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:625 started Oct 09 01:08:45.407653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f190,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=728000000,duration_sec=1267,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:45.408213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:45.408563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:625 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:47.406298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:626 started Oct 09 01:08:47.408635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f192,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=730000000,duration_sec=1269,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:47.409201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:47.409550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:626 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:49.407755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:627 started Oct 09 01:08:49.410201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f194,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=731000000,duration_sec=1271,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:49.410757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:49.411106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:627 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:51.408663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:628 started Oct 09 01:08:51.411283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f196,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=732000000,duration_sec=1273,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:51.411942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:51.412358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:628 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:53.409932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:629 started Oct 09 01:08:53.412266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f198,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=733000000,duration_sec=1275,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:53.412818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:53.413164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:629 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:08:53.993735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b65b38be-1648-4604-9ab3-8d9a8cf43115 admin admin] Resource Subnet deleted: 31d5d7ea-6c5b-48aa-8d26-cb1a4bd8cc90 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:08:53.994108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b65b38be-1648-4604-9ab3-8d9a8cf43115 admin admin] Publish callbacks [] for Subnet (31d5d7ea-6c5b-48aa-8d26-cb1a4bd8cc90), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:54.516875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ba02d74-89d1-4075-a8d0-e86073a5e748 admin admin] Resource Network deleted: 7cd2bff9-2f53-480c-b55a-68a046190b11 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:08:54.517459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ba02d74-89d1-4075-a8d0-e86073a5e748 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (7cd2bff9-2f53-480c-b55a-68a046190b11), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:54.788064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Resource SecurityGroup deleted: ddd5a713-4487-427c-9f3e-9665d0c35a75 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:08:54.788466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (ddd5a713-4487-427c-9f3e-9665d0c35a75), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:54.788929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ddd5a713-4487-427c-9f3e-9665d0c35a75',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:08:54.802952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ddd5a713-4487-427c-9f3e-9665d0c35a75',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:08:54.803351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Resource SecurityGroupRule deleted: 70000fa4-f1de-45bd-93e1-4b1a510b8643 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:08:54.803743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (70000fa4-f1de-45bd-93e1-4b1a510b8643), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:54.804080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Security group rule updated ['ddd5a713-4487-427c-9f3e-9665d0c35a75'] Oct 09 01:08:54.804473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Resource SecurityGroupRule deleted: 74402a7f-c36b-4979-8de2-320789991ca3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:08:54.804820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (74402a7f-c36b-4979-8de2-320789991ca3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:54.805140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Security group rule updated ['ddd5a713-4487-427c-9f3e-9665d0c35a75'] Oct 09 01:08:54.805512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Resource SecurityGroupRule deleted: 782ea946-01f0-4551-bca2-24d76979a8cb {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:08:54.805851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (782ea946-01f0-4551-bca2-24d76979a8cb), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:54.806169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Security group rule updated ['ddd5a713-4487-427c-9f3e-9665d0c35a75'] Oct 09 01:08:54.806708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Resource SecurityGroupRule deleted: 85e78850-3e7d-4531-8bb2-6fa7f8a0a6b0 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:08:54.807026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (85e78850-3e7d-4531-8bb2-6fa7f8a0a6b0), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:54.807343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-3c8ba15a-41a1-4473-bb3d-b789c1514941 admin admin] Security group rule updated ['ddd5a713-4487-427c-9f3e-9665d0c35a75'] Oct 09 01:08:55.410906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:630 started Oct 09 01:08:55.413346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f19a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=734000000,duration_sec=1277,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:55.413918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:55.414272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:630 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:08:55.710261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:08:55Z,description='Default security group',id=bea7ab72-1f65-47e7-bcea-64ca18bb7f58,is_default=True,name='default',project_id='1fef9408db82475ab8903f48e483dd1b',revision_number=1,rules=[SecurityGroupRule(5c2446ed-010e-407b-945f-78ada5423cb8),SecurityGroupRule(749aa59f-fb79-4fa9-b93f-72485da4bd86),SecurityGroupRule(abc0a1ac-da3a-4036-a123-72c2b38f19ee),SecurityGroupRule(d47a8eba-91cb-4445-a06a-24d53639b570)],shared=False,stateful=True,updated_at=2022-10-09T01:08:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:55.710910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (bea7ab72-1f65-47e7-bcea-64ca18bb7f58), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:55.711249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:08:55Z,description=,direction='ingress',ethertype='IPv4',id=5c2446ed-010e-407b-945f-78ada5423cb8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol=,remote_address_group_id=,remote_group_id=bea7ab72-1f65-47e7-bcea-64ca18bb7f58,remote_ip_prefix=,revision_number=0,security_group_id=bea7ab72-1f65-47e7-bcea-64ca18bb7f58,updated_at=2022-10-09T01:08:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:55.711619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5c2446ed-010e-407b-945f-78ada5423cb8), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:55.711954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Security group rule updated ['bea7ab72-1f65-47e7-bcea-64ca18bb7f58'] Oct 09 01:08:55.712623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:08:55Z,description=,direction='ingress',ethertype='IPv6',id=749aa59f-fb79-4fa9-b93f-72485da4bd86,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol=,remote_address_group_id=,remote_group_id=bea7ab72-1f65-47e7-bcea-64ca18bb7f58,remote_ip_prefix=,revision_number=0,security_group_id=bea7ab72-1f65-47e7-bcea-64ca18bb7f58,updated_at=2022-10-09T01:08:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:55.712995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (749aa59f-fb79-4fa9-b93f-72485da4bd86), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:55.713319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Security group rule updated ['bea7ab72-1f65-47e7-bcea-64ca18bb7f58'] Oct 09 01:08:55.713959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:08:55Z,description=,direction='egress',ethertype='IPv4',id=abc0a1ac-da3a-4036-a123-72c2b38f19ee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bea7ab72-1f65-47e7-bcea-64ca18bb7f58,updated_at=2022-10-09T01:08:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:55.714300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (abc0a1ac-da3a-4036-a123-72c2b38f19ee), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:55.714676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Security group rule updated ['bea7ab72-1f65-47e7-bcea-64ca18bb7f58'] Oct 09 01:08:55.715345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:08:55Z,description=,direction='egress',ethertype='IPv6',id=d47a8eba-91cb-4445-a06a-24d53639b570,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bea7ab72-1f65-47e7-bcea-64ca18bb7f58,updated_at=2022-10-09T01:08:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:55.715739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (d47a8eba-91cb-4445-a06a-24d53639b570), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:55.716055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Security group rule updated ['bea7ab72-1f65-47e7-bcea-64ca18bb7f58'] Oct 09 01:08:55.851644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T01:08:55Z,description='',dns_domain=None,id=b61dd093-5d2d-4770-aeef-41797121c0d3,mtu=1500,name='tempest-TestShelveInstance-1133700105-network',project_id='1fef9408db82475ab8903f48e483dd1b',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(b61dd093-5d2d-4770-aeef-41797121c0d3),segments=[NetworkSegment(634e18ea-c71b-4f47-b261-6ea83482889a)],shared=False,status='ACTIVE',updated_at=2022-10-09T01:08:55Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:55.852027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (b61dd093-5d2d-4770-aeef-41797121c0d3), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-1df3ca71-3d0c-4392-a713-a2ac8d4529c5 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network b61dd093-5d2d-4770-aeef-41797121c0d3 with segmentation id not found. Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 01:08:55.919335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 01:08:55.920793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 01:08:55.920793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 01:08:55.920793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 01:08:55.920793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network b61dd093-5d2d-4770-aeef-41797121c0d3 with segmentation id not found. Oct 09 01:08:55.920793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 01:08:56.107529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ce85f71a-267a-4cc4-bcf5-1d601565003d admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4c56e116-cbf3-44ca-9bab-ffc2b24ccd00)],cidr=172.20.0.0/28,created_at=2022-10-09T01:08:55Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=16487830-47c2-4172-aeb2-afd8c04c19f1,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-1133700105-subnet',network_id=b61dd093-5d2d-4770-aeef-41797121c0d3,project_id='1fef9408db82475ab8903f48e483dd1b',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T01:08:55Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:56.107928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ce85f71a-267a-4cc4-bcf5-1d601565003d admin admin] Publish callbacks [] for Subnet (16487830-47c2-4172-aeb2-afd8c04c19f1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:56.595024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7973eab2-d402-49ff-8b9d-0af99ced3b45 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:08:56Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b61dd093-5d2d-4770-aeef-41797121c0d3',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c13661b4-9ee4-4b24-a8ad-28d21d7f80b9,mac_address=fa:16:3e:2f:1c:3b,name='',network_id=b61dd093-5d2d-4770-aeef-41797121c0d3,numa_affinity_policy=,project_id='1fef9408db82475ab8903f48e483dd1b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c13661b4-9ee4-4b24-a8ad-28d21d7f80b9),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:08:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:56.595551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7973eab2-d402-49ff-8b9d-0af99ced3b45 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c13661b4-9ee4-4b24-a8ad-28d21d7f80b9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:56.815576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7973eab2-d402-49ff-8b9d-0af99ced3b45 None None] Resource Port c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c13661b4-9ee4-4b24-a8ad-28d21d7f80b9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c13661b4-9ee4-4b24-a8ad-28d21d7f80b9,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c13661b4-9ee4-4b24-a8ad-28d21d7f80b9,segment=NetworkSegment(634e18ea-c71b-4f47-b261-6ea83482889a),segment_id=634e18ea-c71b-4f47-b261-6ea83482889a)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:56.816236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7973eab2-d402-49ff-8b9d-0af99ced3b45 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c13661b4-9ee4-4b24-a8ad-28d21d7f80b9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:56.901934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["edf3346f-1aef-4582-a51c-39c935ebec49","insert","tapc13661b4-9e",["set",[]],["map",[["attached-mac","fa:16:3e:2f:1c:3b"],["iface-id","c13661b4-9ee4-4b24-a8ad-28d21d7f80b9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:08:56.932082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["edf3346f-1aef-4582-a51c-39c935ebec49","old",null,["set",[]],null],["","new","tapc13661b4-9e",33,["map",[["attached-mac","fa:16:3e:2f:1c:3b"],["iface-id","c13661b4-9ee4-4b24-a8ad-28d21d7f80b9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:08:56.939162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8deb8ee7-a318-455f-b577-01f6813bd571 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:08:56Z,data_plane_status=None,description='',device_id='dc852a6e-9ec0-4808-8335-081a187aecce',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f444d59a-9b81-400a-b7ab-85e0d74fa75b,mac_address=fa:16:3e:3e:96:3e,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f444d59a-9b81-400a-b7ab-85e0d74fa75b),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:08:56Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:56.939551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8deb8ee7-a318-455f-b577-01f6813bd571 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f444d59a-9b81-400a-b7ab-85e0d74fa75b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:57.412362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:631 started Oct 09 01:08:57.414771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f19c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=736000000,duration_sec=1279,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:57.415382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:57.415934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:631 - starting polling. Elapsed:0.004 Oct 09 01:08:57.417311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:57.418762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:631 - port information retrieved. Elapsed:0.007 Oct 09 01:08:57.419081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', '8909d97f-c5e3-462a-9bad-225ac2909771', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'}, 'removed': set(), 'updated': {'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:08:57.419702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b61dd093-5d2d-4770-aeef-41797121c0d3', 'network_id': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'port_id': 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', 'mac_address': 'fa:16:3e:2f:1c:3b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '16487830-47c2-4172-aeb2-afd8c04c19f1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:08:57.421289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:08:57.421630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 updated. Details: {'device': 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b61dd093-5d2d-4770-aeef-41797121c0d3', 'network_id': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'port_id': 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', 'mac_address': 'fa:16:3e:2f:1c:3b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '16487830-47c2-4172-aeb2-afd8c04c19f1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 01:08:57.421985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 13 as local vlan for net-id=b61dd093-5d2d-4770-aeef-41797121c0d3, seg-id=657 Oct 09 01:08:57.424695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da184b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4753), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:57.430716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363f19e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4109)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4753}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:57.431807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc13661b4-9e, col_values=(('tag', 13),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:57.432439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapc13661b4-9e, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:57.432868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapc13661b4-9e, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:57.439580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc13661b4-9e, col_values=(('other_config', {'net_uuid': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '657'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:57.450538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1a0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:57.451465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:631 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.031 Oct 09 01:08:57.451869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:08:57.452176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'} Oct 09 01:08:57.454050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:08:57.454351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:08:57.456660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:08:57.498881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c3dea6-c751-4a35-b634-28337faea91f]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:08:57.499803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:631 - agent port security group processed in 0.080 Oct 09 01:08:57.500675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:08:57.764824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'] and devices down [] completed. Oct 09 01:08:57.765155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:631 - ports processed. Elapsed:0.353 Oct 09 01:08:57.765490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:631 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.353 Oct 09 01:08:57.885323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:57.886926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (c13661b4-9ee4-4b24-a8ad-28d21d7f80b9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:58.353535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ec6b359f-851f-46c2-8a6f-a0e3f6011817 None None] Resource Port f444d59a-9b81-400a-b7ab-85e0d74fa75b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=f444d59a-9b81-400a-b7ab-85e0d74fa75b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f444d59a-9b81-400a-b7ab-85e0d74fa75b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:58.354574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ec6b359f-851f-46c2-8a6f-a0e3f6011817 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f444d59a-9b81-400a-b7ab-85e0d74fa75b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:58.528052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ec6b359f-851f-46c2-8a6f-a0e3f6011817 None None] Resource Port f444d59a-9b81-400a-b7ab-85e0d74fa75b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f444d59a-9b81-400a-b7ab-85e0d74fa75b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f444d59a-9b81-400a-b7ab-85e0d74fa75b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f444d59a-9b81-400a-b7ab-85e0d74fa75b,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:58.528670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ec6b359f-851f-46c2-8a6f-a0e3f6011817 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f444d59a-9b81-400a-b7ab-85e0d74fa75b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:58.714655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8a149f07-c6cc-41e7-b1be-097eafa0dd16 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:08:58Z,data_plane_status=None,description='',device_id='dc852a6e-9ec0-4808-8335-081a187aecce',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2e3d988c-dd60-42c0-b5ee-878212bb71f6,mac_address=fa:16:3e:55:07:bc,name='',network_id=b61dd093-5d2d-4770-aeef-41797121c0d3,numa_affinity_policy=,project_id='1fef9408db82475ab8903f48e483dd1b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2e3d988c-dd60-42c0-b5ee-878212bb71f6),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:08:58Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:08:58.715055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8a149f07-c6cc-41e7-b1be-097eafa0dd16 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (2e3d988c-dd60-42c0-b5ee-878212bb71f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:59.010168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c8e7b2e3-a7ed-4a49-b177-7aacdc4ab698","insert","qg-f444d59a-9b",["set",[]],["map",[["attached-mac","fa:16:3e:3e:96:3e"],["iface-id","f444d59a-9b81-400a-b7ab-85e0d74fa75b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:08:59.028456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c8e7b2e3-a7ed-4a49-b177-7aacdc4ab698","old",null,["set",[]],null],["","new","qg-f444d59a-9b",34,["map",[["attached-mac","fa:16:3e:3e:96:3e"],["iface-id","f444d59a-9b81-400a-b7ab-85e0d74fa75b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:08:59.157509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8a149f07-c6cc-41e7-b1be-097eafa0dd16 admin admin] Received resource Port update without any changes: 2e3d988c-dd60-42c0-b5ee-878212bb71f6 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 01:08:59.413087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:632 started Oct 09 01:08:59.416867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=737000000,duration_sec=1281,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:59.417542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:08:59.418133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:632 - starting polling. Elapsed:0.005 Oct 09 01:08:59.419806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:08:59.421676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:632 - port information retrieved. Elapsed:0.009 Oct 09 01:08:59.422267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '8909d97f-c5e3-462a-9bad-225ac2909771', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'f444d59a-9b81-400a-b7ab-85e0d74fa75b'}, 'removed': set(), 'updated': {'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:08:59.422975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'device_id': 'dc852a6e-9ec0-4808-8335-081a187aecce', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'mac_address': 'fa:16:3e:3e:96:3e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.163'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:08:59.423569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b61dd093-5d2d-4770-aeef-41797121c0d3', 'network_id': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'port_id': 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', 'mac_address': 'fa:16:3e:2f:1c:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '16487830-47c2-4172-aeb2-afd8c04c19f1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:08:59.425252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: f444d59a-9b81-400a-b7ab-85e0d74fa75b {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:08:59.425673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f444d59a-9b81-400a-b7ab-85e0d74fa75b updated. Details: {'device': 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'device_id': 'dc852a6e-9ec0-4808-8335-081a187aecce', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'mac_address': 'fa:16:3e:3e:96:3e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.163'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:08:59.426722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f444d59a-9b, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:59.427272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-f444d59a-9b, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:59.427851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-f444d59a-9b, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:59.436751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f444d59a-9b, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:59.449092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1a4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:59.449430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:08:59.449757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 updated. Details: {'device': 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b61dd093-5d2d-4770-aeef-41797121c0d3', 'network_id': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'port_id': 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', 'mac_address': 'fa:16:3e:2f:1c:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '16487830-47c2-4172-aeb2-afd8c04c19f1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Oct 09 01:08:59.451373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc13661b4-9e, col_values=(('tag', 13),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:59.451812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapc13661b4-9e, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:59.452220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapc13661b4-9e, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:59.452735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:08:59.454087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc13661b4-9e, col_values=(('other_config', {'net_uuid': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '657', 'tag': '13'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:08:59.455007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:08:59.458425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1a6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:08:59.459150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:632 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 6 devices currently available. Time elapsed: 0.037 Oct 09 01:08:59.459929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:08:59.460498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'f444d59a-9b81-400a-b7ab-85e0d74fa75b'} Oct 09 01:08:59.462043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:08:59.462572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:08:59.465137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:08:59.527852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[840aea6a-c99c-4b7b-9a0b-e41390234f72]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:08:59.530736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:08:59.531785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:08:59.534264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:08:59.534727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:08:59.543779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:08:59.592734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cfe1d6-279f-4443-8a16-a64bc45f87bc]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:08:59.593471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:632 - agent port security group processed in 0.171 Oct 09 01:08:59.594180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for f444d59a-9b81-400a-b7ab-85e0d74fa75b to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:08:59.594465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:08:59.985186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port f444d59a-9b81-400a-b7ab-85e0d74fa75b updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f444d59a-9b81-400a-b7ab-85e0d74fa75b,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f444d59a-9b81-400a-b7ab-85e0d74fa75b,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:08:59.986097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (f444d59a-9b81-400a-b7ab-85e0d74fa75b), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:00.062169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'] and devices down [] completed. Oct 09 01:09:00.062738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:632 - ports processed. Elapsed:0.649 Oct 09 01:09:00.062738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:632 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.650 Oct 09 01:09:00.253208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:09:00Z,description='Default security group',id=e4c98132-a3ae-485b-b3d0-cd9f5b52570e,is_default=True,name='default',project_id='ab20088cee27434ab33024d0693c44bd',revision_number=1,rules=[SecurityGroupRule(101620f9-e725-4668-bbcb-c5d038965bda),SecurityGroupRule(1938e51c-edd9-4b5e-88c3-847a058b9249),SecurityGroupRule(3fe0a0cc-649f-47da-8741-39e2b796a2f9),SecurityGroupRule(b93fa27e-57aa-4ba4-a1ac-23cf017d866f)],shared=False,stateful=True,updated_at=2022-10-09T01:09:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:00.253660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (e4c98132-a3ae-485b-b3d0-cd9f5b52570e), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:00.254363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:00Z,description=,direction='egress',ethertype='IPv6',id=101620f9-e725-4668-bbcb-c5d038965bda,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab20088cee27434ab33024d0693c44bd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4c98132-a3ae-485b-b3d0-cd9f5b52570e,updated_at=2022-10-09T01:09:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:00.254792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (101620f9-e725-4668-bbcb-c5d038965bda), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:00.255209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Security group rule updated ['e4c98132-a3ae-485b-b3d0-cd9f5b52570e'] Oct 09 01:09:00.255968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:00Z,description=,direction='ingress',ethertype='IPv4',id=1938e51c-edd9-4b5e-88c3-847a058b9249,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab20088cee27434ab33024d0693c44bd',protocol=,remote_address_group_id=,remote_group_id=e4c98132-a3ae-485b-b3d0-cd9f5b52570e,remote_ip_prefix=,revision_number=0,security_group_id=e4c98132-a3ae-485b-b3d0-cd9f5b52570e,updated_at=2022-10-09T01:09:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:00.256425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (1938e51c-edd9-4b5e-88c3-847a058b9249), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:00.256877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Security group rule updated ['e4c98132-a3ae-485b-b3d0-cd9f5b52570e'] Oct 09 01:09:00.258681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:00Z,description=,direction='egress',ethertype='IPv4',id=3fe0a0cc-649f-47da-8741-39e2b796a2f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab20088cee27434ab33024d0693c44bd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4c98132-a3ae-485b-b3d0-cd9f5b52570e,updated_at=2022-10-09T01:09:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:00.259245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (3fe0a0cc-649f-47da-8741-39e2b796a2f9), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:00.259470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Security group rule updated ['e4c98132-a3ae-485b-b3d0-cd9f5b52570e'] Oct 09 01:09:00.260305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:00Z,description=,direction='ingress',ethertype='IPv6',id=b93fa27e-57aa-4ba4-a1ac-23cf017d866f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab20088cee27434ab33024d0693c44bd',protocol=,remote_address_group_id=,remote_group_id=e4c98132-a3ae-485b-b3d0-cd9f5b52570e,remote_ip_prefix=,revision_number=0,security_group_id=e4c98132-a3ae-485b-b3d0-cd9f5b52570e,updated_at=2022-10-09T01:09:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:00.260592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b93fa27e-57aa-4ba4-a1ac-23cf017d866f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:00.260919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Security group rule updated ['e4c98132-a3ae-485b-b3d0-cd9f5b52570e'] Oct 09 01:09:00.391084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-09T01:09:00Z,description='',dns_domain=None,id=9199d184-92ab-49f4-b12a-13fa943db117,mtu=1500,name='tempest-TestShelveInstance-943097952-network',project_id='ab20088cee27434ab33024d0693c44bd',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(9199d184-92ab-49f4-b12a-13fa943db117),segments=[NetworkSegment(554884b1-b79d-4aa4-8abc-f1301f261c4b)],shared=False,status='ACTIVE',updated_at=2022-10-09T01:09:00Z,vlan_transparent=) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:00.391328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (9199d184-92ab-49f4-b12a-13fa943db117), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager [None req-4ff96c17-7dab-4748-b45e-751bd3dffc48 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 9199d184-92ab-49f4-b12a-13fa943db117 with segmentation id not found. Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 09 01:09:00.481906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 09 01:09:00.482934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 09 01:09:00.482934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 09 01:09:00.482934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 09 01:09:00.482934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 9199d184-92ab-49f4-b12a-13fa943db117 with segmentation id not found. Oct 09 01:09:00.482934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: ERROR neutron_lib.callbacks.manager Oct 09 01:09:00.648784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6c6b2344-fad5-4cc0-8821-ea8493d5cc2d admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ee9318c1-3a46-4111-b72f-1c646ead0f3e)],cidr=172.20.0.0/28,created_at=2022-10-09T01:09:00Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=6cca7a80-2d7a-4c08-8a93-f46ecf74540f,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-943097952-subnet',network_id=9199d184-92ab-49f4-b12a-13fa943db117,project_id='ab20088cee27434ab33024d0693c44bd',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-09T01:09:00Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:00.649275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6c6b2344-fad5-4cc0-8821-ea8493d5cc2d admin admin] Publish callbacks [] for Subnet (6cca7a80-2d7a-4c08-8a93-f46ecf74540f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:01.414086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:633 started Oct 09 01:09:01.418756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=739000000,duration_sec=1283,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:01.420629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:01.421129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:633 - starting polling. Elapsed:0.007 Oct 09 01:09:01.423215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:01.425342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:633 - port information retrieved. Elapsed:0.011 Oct 09 01:09:01.425948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'25cba434-73ae-44ab-aa76-d477a015b1c7', '8909d97f-c5e3-462a-9bad-225ac2909771', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'f444d59a-9b81-400a-b7ab-85e0d74fa75b'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:09:01.427203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'device_id': 'dc852a6e-9ec0-4808-8335-081a187aecce', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'mac_address': 'fa:16:3e:3e:96:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.163'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:01.429423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: f444d59a-9b81-400a-b7ab-85e0d74fa75b {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:01.429903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f444d59a-9b81-400a-b7ab-85e0d74fa75b updated. Details: {'device': 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'device_id': 'dc852a6e-9ec0-4808-8335-081a187aecce', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'mac_address': 'fa:16:3e:3e:96:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.163'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:09:01.431635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f444d59a-9b, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:01.432196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-f444d59a-9b, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:01.432794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-f444d59a-9b, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:01.433381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:01.435152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f444d59a-9b, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:01.436289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:01.439298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1aa,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:01.439666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:633 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 6 devices currently available. Time elapsed: 0.013 Oct 09 01:09:01.440039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:09:01.440499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:09:01.441925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:09:01.442420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:09:01.448870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:09:01.452967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-8c05976d-ff45-48f2-a85e-04270e084271 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:09:01Z,data_plane_status=None,description='',device_id='8990c51a-b997-4bc6-ad41-d1bae89dcc72',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1693fd7c-438d-4b90-bf3e-c04814a09b2c,mac_address=fa:16:3e:c0:3e:18,name='',network_id=3d48f00d-dd5a-4867-a3e0-929aeb72c042,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1693fd7c-438d-4b90-bf3e-c04814a09b2c),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:09:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:01.453601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-8c05976d-ff45-48f2-a85e-04270e084271 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (1693fd7c-438d-4b90-bf3e-c04814a09b2c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:01.506081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b04fd8-87c8-445b-9388-426dcf0e301a]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:09:01.507064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:633 - agent port security group processed in 0.081 Oct 09 01:09:01.508607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for f444d59a-9b81-400a-b7ab-85e0d74fa75b to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:01.540818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ec851528-d97f-4302-bf4c-ebebc62ea9bd None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:09:00Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-9199d184-92ab-49f4-b12a-13fa943db117',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6ebc715b-f504-4d86-894f-3858c5ca3ba1,mac_address=fa:16:3e:61:f4:31,name='',network_id=9199d184-92ab-49f4-b12a-13fa943db117,numa_affinity_policy=,project_id='ab20088cee27434ab33024d0693c44bd',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6ebc715b-f504-4d86-894f-3858c5ca3ba1),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:09:01Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:01.541285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ec851528-d97f-4302-bf4c-ebebc62ea9bd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6ebc715b-f504-4d86-894f-3858c5ca3ba1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:01.686990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a674c692-334b-4bfc-9f87-0ca315013621 None None] Resource Port 2e3d988c-dd60-42c0-b5ee-878212bb71f6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=2e3d988c-dd60-42c0-b5ee-878212bb71f6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2e3d988c-dd60-42c0-b5ee-878212bb71f6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:01.687739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a674c692-334b-4bfc-9f87-0ca315013621 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (2e3d988c-dd60-42c0-b5ee-878212bb71f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:01.948580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['f444d59a-9b81-400a-b7ab-85e0d74fa75b'] and devices down [] completed. Oct 09 01:09:01.949133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:633 - ports processed. Elapsed:0.535 Oct 09 01:09:01.949462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:633 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.536 Oct 09 01:09:02.115319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-a674c692-334b-4bfc-9f87-0ca315013621 None None] Resource Port 2e3d988c-dd60-42c0-b5ee-878212bb71f6 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2e3d988c-dd60-42c0-b5ee-878212bb71f6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2e3d988c-dd60-42c0-b5ee-878212bb71f6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2e3d988c-dd60-42c0-b5ee-878212bb71f6,segment=NetworkSegment(634e18ea-c71b-4f47-b261-6ea83482889a),segment_id=634e18ea-c71b-4f47-b261-6ea83482889a)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:02.116011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-a674c692-334b-4bfc-9f87-0ca315013621 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (2e3d988c-dd60-42c0-b5ee-878212bb71f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:02.185991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21b768cb-0b0c-427d-ad38-0b4fd86ea950","insert","tap6ebc715b-f5",["set",[]],["map",[["attached-mac","fa:16:3e:61:f4:31"],["iface-id","6ebc715b-f504-4d86-894f-3858c5ca3ba1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:09:02.221579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21b768cb-0b0c-427d-ad38-0b4fd86ea950","old",null,["set",[]],null],["","new","tap6ebc715b-f5",35,["map",[["attached-mac","fa:16:3e:61:f4:31"],["iface-id","6ebc715b-f504-4d86-894f-3858c5ca3ba1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:09:02.358728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ec851528-d97f-4302-bf4c-ebebc62ea9bd None None] Resource Port 6ebc715b-f504-4d86-894f-3858c5ca3ba1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6ebc715b-f504-4d86-894f-3858c5ca3ba1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6ebc715b-f504-4d86-894f-3858c5ca3ba1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6ebc715b-f504-4d86-894f-3858c5ca3ba1,segment=NetworkSegment(554884b1-b79d-4aa4-8abc-f1301f261c4b),segment_id=554884b1-b79d-4aa4-8abc-f1301f261c4b)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:02.359117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ec851528-d97f-4302-bf4c-ebebc62ea9bd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6ebc715b-f504-4d86-894f-3858c5ca3ba1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:02.646822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7821bc5b-305d-430f-960a-09b26e88eee8","insert","qr-2e3d988c-dd",["set",[]],["map",[["attached-mac","fa:16:3e:55:07:bc"],["iface-id","2e3d988c-dd60-42c0-b5ee-878212bb71f6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:09:02.668293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7821bc5b-305d-430f-960a-09b26e88eee8","old",null,["set",[]],null],["","new","qr-2e3d988c-dd",36,["map",[["attached-mac","fa:16:3e:55:07:bc"],["iface-id","2e3d988c-dd60-42c0-b5ee-878212bb71f6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:09:03.360986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1f02636f-7603-4ed3-891f-190bc8520f23 None None] Resource Port 1693fd7c-438d-4b90-bf3e-c04814a09b2c updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=1693fd7c-438d-4b90-bf3e-c04814a09b2c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1693fd7c-438d-4b90-bf3e-c04814a09b2c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:03.361457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1f02636f-7603-4ed3-891f-190bc8520f23 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (1693fd7c-438d-4b90-bf3e-c04814a09b2c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:03.415371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:634 started Oct 09 01:09:03.418741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=739000000,duration_sec=1285,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:03.419437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:03.420681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:634 - starting polling. Elapsed:0.005 Oct 09 01:09:03.422811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:03.425436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:634 - port information retrieved. Elapsed:0.010 Oct 09 01:09:03.426030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '25cba434-73ae-44ab-aa76-d477a015b1c7', '2e3d988c-dd60-42c0-b5ee-878212bb71f6', '8909d97f-c5e3-462a-9bad-225ac2909771', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6'}, 'removed': set(), 'updated': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:09:03.426922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '6ebc715b-f504-4d86-894f-3858c5ca3ba1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-9199d184-92ab-49f4-b12a-13fa943db117', 'network_id': '9199d184-92ab-49f4-b12a-13fa943db117', 'port_id': '6ebc715b-f504-4d86-894f-3858c5ca3ba1', 'mac_address': 'fa:16:3e:61:f4:31', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6cca7a80-2d7a-4c08-8a93-f46ecf74540f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:03.430055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '2e3d988c-dd60-42c0-b5ee-878212bb71f6', 'device_id': 'dc852a6e-9ec0-4808-8335-081a187aecce', 'network_id': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'port_id': '2e3d988c-dd60-42c0-b5ee-878212bb71f6', 'mac_address': 'fa:16:3e:55:07:bc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '16487830-47c2-4172-aeb2-afd8c04c19f1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:03.432550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 6ebc715b-f504-4d86-894f-3858c5ca3ba1 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:03.435426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 6ebc715b-f504-4d86-894f-3858c5ca3ba1 updated. Details: {'device': '6ebc715b-f504-4d86-894f-3858c5ca3ba1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-9199d184-92ab-49f4-b12a-13fa943db117', 'network_id': '9199d184-92ab-49f4-b12a-13fa943db117', 'port_id': '6ebc715b-f504-4d86-894f-3858c5ca3ba1', 'mac_address': 'fa:16:3e:61:f4:31', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6cca7a80-2d7a-4c08-8a93-f46ecf74540f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 09 01:09:03.436089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Assigning 14 as local vlan for net-id=9199d184-92ab-49f4-b12a-13fa943db117, seg-id=660 Oct 09 01:09:03.441755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e720a471-e179-471a-9688-73f838407cb1 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-09T01:09:02Z,data_plane_status=None,description='',device_id='8990c51a-b997-4bc6-ad41-d1bae89dcc72',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=210af4c8-f369-4d4c-8082-46227be5b2f5,mac_address=fa:16:3e:5f:99:6c,name='',network_id=9199d184-92ab-49f4-b12a-13fa943db117,numa_affinity_policy=,project_id='ab20088cee27434ab33024d0693c44bd',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(210af4c8-f369-4d4c-8082-46227be5b2f5),security_group_ids=set([]),status='DOWN',updated_at=2022-10-09T01:09:03Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:03.448779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-e720a471-e179-471a-9688-73f838407cb1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (210af4c8-f369-4d4c-8082-46227be5b2f5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:03.459067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-7d5866b6-65dc-44bb-be10-58f3e17fd400 None None] Resource Port 6ebc715b-f504-4d86-894f-3858c5ca3ba1 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:03.459978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-7d5866b6-65dc-44bb-be10-58f3e17fd400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (6ebc715b-f504-4d86-894f-3858c5ca3ba1), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:03.465464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x32da184d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=1503099881718125406,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4756), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:03.469961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x363f1ae,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4110)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4756}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:03.474267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6ebc715b-f5, col_values=(('tag', 14),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:03.474704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap6ebc715b-f5, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:03.475139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap6ebc715b-f5, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:03.486900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6ebc715b-f5, col_values=(('other_config', {'net_uuid': '9199d184-92ab-49f4-b12a-13fa943db117', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '660'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:03.498129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1b0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:03.499018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 2e3d988c-dd60-42c0-b5ee-878212bb71f6 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:03.499639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 2e3d988c-dd60-42c0-b5ee-878212bb71f6 updated. Details: {'device': '2e3d988c-dd60-42c0-b5ee-878212bb71f6', 'device_id': 'dc852a6e-9ec0-4808-8335-081a187aecce', 'network_id': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'port_id': '2e3d988c-dd60-42c0-b5ee-878212bb71f6', 'mac_address': 'fa:16:3e:55:07:bc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '16487830-47c2-4172-aeb2-afd8c04c19f1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Oct 09 01:09:03.501414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2e3d988c-dd, col_values=(('tag', 13),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:03.504448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-2e3d988c-dd, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:03.505215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-2e3d988c-dd, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:03.514984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2e3d988c-dd, col_values=(('other_config', {'net_uuid': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '657'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:03.532500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1b2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:03.533369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:634 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.107 Oct 09 01:09:03.534866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 2 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:09:03.535412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6'} Oct 09 01:09:03.538485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:09:03.543295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:09:03.561795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:09:03.579849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1f02636f-7603-4ed3-891f-190bc8520f23 None None] Resource Port 1693fd7c-438d-4b90-bf3e-c04814a09b2c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1693fd7c-438d-4b90-bf3e-c04814a09b2c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1693fd7c-438d-4b90-bf3e-c04814a09b2c,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1693fd7c-438d-4b90-bf3e-c04814a09b2c,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:03.580245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1f02636f-7603-4ed3-891f-190bc8520f23 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (1693fd7c-438d-4b90-bf3e-c04814a09b2c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:03.643112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[57eba95e-06e3-4e7f-83b0-160fe253a78e]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:09:03.643896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:634 - agent port security group processed in 0.217 Oct 09 01:09:03.644718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 6ebc715b-f504-4d86-894f-3858c5ca3ba1 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:03.645120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 2e3d988c-dd60-42c0-b5ee-878212bb71f6 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:04.096981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-e720a471-e179-471a-9688-73f838407cb1 admin admin] Received resource Port update without any changes: 210af4c8-f369-4d4c-8082-46227be5b2f5 {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 09 01:09:04.188450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6'] and devices down [] completed. Oct 09 01:09:04.189052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:634 - ports processed. Elapsed:0.774 Oct 09 01:09:04.189549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:634 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:0.774 Oct 09 01:09:04.248171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 2e3d988c-dd60-42c0-b5ee-878212bb71f6 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:04.248826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (2e3d988c-dd60-42c0-b5ee-878212bb71f6), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:04.366952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a05f130e-51d1-4919-aa6a-9406302195df","insert","qg-1693fd7c-43",["set",[]],["map",[["attached-mac","fa:16:3e:c0:3e:18"],["iface-id","1693fd7c-438d-4b90-bf3e-c04814a09b2c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:09:04.390141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a05f130e-51d1-4919-aa6a-9406302195df","old",null,["set",[]],null],["","new","qg-1693fd7c-43",37,["map",[["attached-mac","fa:16:3e:c0:3e:18"],["iface-id","1693fd7c-438d-4b90-bf3e-c04814a09b2c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:09:05.416097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:635 started Oct 09 01:09:05.418956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=739000000,duration_sec=1287,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:05.420045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:05.420507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:635 - starting polling. Elapsed:0.005 Oct 09 01:09:05.422203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:05.424318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:635 - port information retrieved. Elapsed:0.008 Oct 09 01:09:05.424651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6', '1693fd7c-438d-4b90-bf3e-c04814a09b2c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'1693fd7c-438d-4b90-bf3e-c04814a09b2c'}, 'removed': set(), 'updated': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6', '1693fd7c-438d-4b90-bf3e-c04814a09b2c'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:09:05.425233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '6ebc715b-f504-4d86-894f-3858c5ca3ba1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-9199d184-92ab-49f4-b12a-13fa943db117', 'network_id': '9199d184-92ab-49f4-b12a-13fa943db117', 'port_id': '6ebc715b-f504-4d86-894f-3858c5ca3ba1', 'mac_address': 'fa:16:3e:61:f4:31', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6cca7a80-2d7a-4c08-8a93-f46ecf74540f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:05.425706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '1693fd7c-438d-4b90-bf3e-c04814a09b2c', 'device_id': '8990c51a-b997-4bc6-ad41-d1bae89dcc72', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '1693fd7c-438d-4b90-bf3e-c04814a09b2c', 'mac_address': 'fa:16:3e:c0:3e:18', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.208'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:05.426160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '2e3d988c-dd60-42c0-b5ee-878212bb71f6', 'device_id': 'dc852a6e-9ec0-4808-8335-081a187aecce', 'network_id': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'port_id': '2e3d988c-dd60-42c0-b5ee-878212bb71f6', 'mac_address': 'fa:16:3e:55:07:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '16487830-47c2-4172-aeb2-afd8c04c19f1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:05.428139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 6ebc715b-f504-4d86-894f-3858c5ca3ba1 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:05.428457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 6ebc715b-f504-4d86-894f-3858c5ca3ba1 updated. Details: {'device': '6ebc715b-f504-4d86-894f-3858c5ca3ba1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-9199d184-92ab-49f4-b12a-13fa943db117', 'network_id': '9199d184-92ab-49f4-b12a-13fa943db117', 'port_id': '6ebc715b-f504-4d86-894f-3858c5ca3ba1', 'mac_address': 'fa:16:3e:61:f4:31', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6cca7a80-2d7a-4c08-8a93-f46ecf74540f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Oct 09 01:09:05.429492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6ebc715b-f5, col_values=(('tag', 14),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.429914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap6ebc715b-f5, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.430308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap6ebc715b-f5, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.430751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:05.431491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6ebc715b-f5, col_values=(('other_config', {'net_uuid': '9199d184-92ab-49f4-b12a-13fa943db117', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '660', 'tag': '14'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.432186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:05.434236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1b6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:05.434569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 1693fd7c-438d-4b90-bf3e-c04814a09b2c {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:05.434888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 1693fd7c-438d-4b90-bf3e-c04814a09b2c updated. Details: {'device': '1693fd7c-438d-4b90-bf3e-c04814a09b2c', 'device_id': '8990c51a-b997-4bc6-ad41-d1bae89dcc72', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '1693fd7c-438d-4b90-bf3e-c04814a09b2c', 'mac_address': 'fa:16:3e:c0:3e:18', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.208'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:09:05.436341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-1693fd7c-43, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.436758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-1693fd7c-43, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.437193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-1693fd7c-43, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.442889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-1693fd7c-43, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.448342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1b8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:05.448670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 2e3d988c-dd60-42c0-b5ee-878212bb71f6 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:05.448996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 2e3d988c-dd60-42c0-b5ee-878212bb71f6 updated. Details: {'device': '2e3d988c-dd60-42c0-b5ee-878212bb71f6', 'device_id': 'dc852a6e-9ec0-4808-8335-081a187aecce', 'network_id': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'port_id': '2e3d988c-dd60-42c0-b5ee-878212bb71f6', 'mac_address': 'fa:16:3e:55:07:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '16487830-47c2-4172-aeb2-afd8c04c19f1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Oct 09 01:09:05.450480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2e3d988c-dd, col_values=(('tag', 13),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.450912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-2e3d988c-dd, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.451309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-2e3d988c-dd, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.451770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:05.452516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2e3d988c-dd, col_values=(('other_config', {'net_uuid': 'b61dd093-5d2d-4770-aeef-41797121c0d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '657', 'tag': '13'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:05.453190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:05.455316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1ba,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:05.455818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:635 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.031 Oct 09 01:09:05.456184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:09:05.456485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'1693fd7c-438d-4b90-bf3e-c04814a09b2c'} Oct 09 01:09:05.457632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:09:05.457993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:09:05.460817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:09:05.498617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1344e3-8d9e-4840-8afb-89d8c95e82c6]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:09:05.499228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 2 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:09:05.499534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:09:05.501317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:09:05.501607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:09:05.505123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:09:05.540958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[070efc1e-badd-4bc9-98f3-a7afd3910c12]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:09:05.541478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:635 - agent port security group processed in 0.116 Oct 09 01:09:05.542240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 6ebc715b-f504-4d86-894f-3858c5ca3ba1 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:05.542537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 1693fd7c-438d-4b90-bf3e-c04814a09b2c to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:05.542837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 2e3d988c-dd60-42c0-b5ee-878212bb71f6 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:05.918307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 1693fd7c-438d-4b90-bf3e-c04814a09b2c updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1693fd7c-438d-4b90-bf3e-c04814a09b2c,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1693fd7c-438d-4b90-bf3e-c04814a09b2c,segment=NetworkSegment(466209de-cb09-4473-8033-6597828bc645),segment_id=466209de-cb09-4473-8033-6597828bc645)], 'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:05.918703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (1693fd7c-438d-4b90-bf3e-c04814a09b2c), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:05.965311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb2b1787-e786-4edf-a032-337311d0e979 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-09T01:09:05Z,description='tempest-secgroup-smoke-1763834362 description',id=01d80b84-51cc-4919-9308-5922e4085615,is_default=False,name='tempest-secgroup-smoke-1763834362',project_id='1fef9408db82475ab8903f48e483dd1b',revision_number=1,rules=[SecurityGroupRule(883d450e-a0fb-48ca-b9fe-74134435e1cd),SecurityGroupRule(fc2da4b0-f5f9-4a88-af79-d1a820270dc2)],shared=False,stateful=True,updated_at=2022-10-09T01:09:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:05.966069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb2b1787-e786-4edf-a032-337311d0e979 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-389580'] for SecurityGroup (01d80b84-51cc-4919-9308-5922e4085615), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:05.966833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb2b1787-e786-4edf-a032-337311d0e979 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:05Z,description=,direction='egress',ethertype='IPv4',id=883d450e-a0fb-48ca-b9fe-74134435e1cd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01d80b84-51cc-4919-9308-5922e4085615,updated_at=2022-10-09T01:09:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:05.967611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb2b1787-e786-4edf-a032-337311d0e979 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (883d450e-a0fb-48ca-b9fe-74134435e1cd), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:05.967945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eb2b1787-e786-4edf-a032-337311d0e979 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:09:05.968756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-eb2b1787-e786-4edf-a032-337311d0e979 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:05Z,description=,direction='egress',ethertype='IPv6',id=fc2da4b0-f5f9-4a88-af79-d1a820270dc2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01d80b84-51cc-4919-9308-5922e4085615,updated_at=2022-10-09T01:09:05Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:05.969108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-eb2b1787-e786-4edf-a032-337311d0e979 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (fc2da4b0-f5f9-4a88-af79-d1a820270dc2), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:05.969518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-eb2b1787-e786-4edf-a032-337311d0e979 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:09:06.007470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['6ebc715b-f504-4d86-894f-3858c5ca3ba1', '1693fd7c-438d-4b90-bf3e-c04814a09b2c', '2e3d988c-dd60-42c0-b5ee-878212bb71f6'] and devices down [] completed. Oct 09 01:09:06.008223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:635 - ports processed. Elapsed:0.592 Oct 09 01:09:06.008625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:635 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:0.593 Oct 09 01:09:06.080499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b053973c-67b8-447d-93ea-6b1ca7c9db31 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:06Z,description='',direction='ingress',ethertype='IPv4',id=5328f75f-9c3b-4e5c-b2b9-519280c55f2d,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1fef9408db82475ab8903f48e483dd1b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01d80b84-51cc-4919-9308-5922e4085615,updated_at=2022-10-09T01:09:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:06.080859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b053973c-67b8-447d-93ea-6b1ca7c9db31 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (5328f75f-9c3b-4e5c-b2b9-519280c55f2d), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:06.081430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b053973c-67b8-447d-93ea-6b1ca7c9db31 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:09:06.205053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-b7bd26cd-bfce-4dc7-9712-c8dc3f90a650 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:06Z,description='',direction='egress',ethertype='IPv4',id=ef325899-405e-4c56-b95d-1882d1651acf,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1fef9408db82475ab8903f48e483dd1b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01d80b84-51cc-4919-9308-5922e4085615,updated_at=2022-10-09T01:09:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:06.205519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-b7bd26cd-bfce-4dc7-9712-c8dc3f90a650 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (ef325899-405e-4c56-b95d-1882d1651acf), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:06.205924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-b7bd26cd-bfce-4dc7-9712-c8dc3f90a650 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:09:06.340358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-6bd1e6a9-f967-455a-8378-d51abb41ed1d tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:06Z,description='',direction='ingress',ethertype='IPv4',id=4595d252-d1c9-4715-b016-212b2e846fad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01d80b84-51cc-4919-9308-5922e4085615,updated_at=2022-10-09T01:09:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:06.340358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-6bd1e6a9-f967-455a-8378-d51abb41ed1d tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (4595d252-d1c9-4715-b016-212b2e846fad), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:06.340358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-6bd1e6a9-f967-455a-8378-d51abb41ed1d tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:09:06.459531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f9520d79-b25b-4c4f-bc06-3898db6cc348 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:06Z,description='',direction='egress',ethertype='IPv4',id=b8093d1a-61dc-4493-982f-6215f97d1289,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01d80b84-51cc-4919-9308-5922e4085615,updated_at=2022-10-09T01:09:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:06.460199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f9520d79-b25b-4c4f-bc06-3898db6cc348 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (b8093d1a-61dc-4493-982f-6215f97d1289), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:06.460972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-f9520d79-b25b-4c4f-bc06-3898db6cc348 tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:09:06.598398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-56c47839-deef-42f9-b1ad-18b17fccd05b tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:06Z,description='',direction='ingress',ethertype='IPv6',id=6cdcf08c-b99d-4f5c-a46e-a8a384802eed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01d80b84-51cc-4919-9308-5922e4085615,updated_at=2022-10-09T01:09:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:06.598905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-56c47839-deef-42f9-b1ad-18b17fccd05b tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (6cdcf08c-b99d-4f5c-a46e-a8a384802eed), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:06.599337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-56c47839-deef-42f9-b1ad-18b17fccd05b tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:09:06.734905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-11c4d7b7-7df9-40e5-8010-5a715ec0f61c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-09T01:09:06Z,description='',direction='egress',ethertype='IPv6',id=01552807-3f6b-4244-ad2b-e594e90dc06f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fef9408db82475ab8903f48e483dd1b',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01d80b84-51cc-4919-9308-5922e4085615,updated_at=2022-10-09T01:09:06Z) {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 09 01:09:06.735726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-11c4d7b7-7df9-40e5-8010-5a715ec0f61c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-389609'] for SecurityGroupRule (01552807-3f6b-4244-ad2b-e594e90dc06f), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:06.736447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-11c4d7b7-7df9-40e5-8010-5a715ec0f61c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:09:06.889860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-05b229cb-f217-45b3-8139-9cfeb66e0c6b None None] Resource Port 210af4c8-f369-4d4c-8082-46227be5b2f5 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=210af4c8-f369-4d4c-8082-46227be5b2f5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=210af4c8-f369-4d4c-8082-46227be5b2f5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:06.890432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-05b229cb-f217-45b3-8139-9cfeb66e0c6b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (210af4c8-f369-4d4c-8082-46227be5b2f5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:07.140521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-05b229cb-f217-45b3-8139-9cfeb66e0c6b None None] Resource Port 210af4c8-f369-4d4c-8082-46227be5b2f5 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=210af4c8-f369-4d4c-8082-46227be5b2f5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=210af4c8-f369-4d4c-8082-46227be5b2f5,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=210af4c8-f369-4d4c-8082-46227be5b2f5,segment=NetworkSegment(554884b1-b79d-4aa4-8abc-f1301f261c4b),segment_id=554884b1-b79d-4aa4-8abc-f1301f261c4b)]} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:07.141420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-05b229cb-f217-45b3-8139-9cfeb66e0c6b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (210af4c8-f369-4d4c-8082-46227be5b2f5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:07.416976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:636 started Oct 09 01:09:07.420650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=740000000,duration_sec=1289,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:07.421343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:07.421688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:636 - starting polling. Elapsed:0.005 Oct 09 01:09:07.423535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:07.425580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:636 - port information retrieved. Elapsed:0.009 Oct 09 01:09:07.426035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6', '1693fd7c-438d-4b90-bf3e-c04814a09b2c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'1693fd7c-438d-4b90-bf3e-c04814a09b2c'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:09:07.426631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '1693fd7c-438d-4b90-bf3e-c04814a09b2c', 'device_id': '8990c51a-b997-4bc6-ad41-d1bae89dcc72', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '1693fd7c-438d-4b90-bf3e-c04814a09b2c', 'mac_address': 'fa:16:3e:c0:3e:18', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.208'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:07.428646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 1693fd7c-438d-4b90-bf3e-c04814a09b2c {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:07.428970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 1693fd7c-438d-4b90-bf3e-c04814a09b2c updated. Details: {'device': '1693fd7c-438d-4b90-bf3e-c04814a09b2c', 'device_id': '8990c51a-b997-4bc6-ad41-d1bae89dcc72', 'network_id': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'port_id': '1693fd7c-438d-4b90-bf3e-c04814a09b2c', 'mac_address': 'fa:16:3e:c0:3e:18', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f92119b-fe6b-47bd-9d10-bb5087854d0d', 'ip_address': '172.37.5.208'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 09 01:09:07.430077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-1693fd7c-43, col_values=(('tag', 2),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:07.430522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-1693fd7c-43, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:07.431118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-1693fd7c-43, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:07.431562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:07.432421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-1693fd7c-43, col_values=(('other_config', {'net_uuid': '3d48f00d-dd5a-4867-a3e0-929aeb72c042', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:07.433053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:07.435806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1be,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:07.436280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:636 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.010 Oct 09 01:09:07.436640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:09:07.436928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:09:07.438059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:09:07.438518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:09:07.441313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:09:07.460731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95efc1a2-ee8a-481a-bddc-562c99b55bcf","insert","qr-210af4c8-f3",["set",[]],["map",[["attached-mac","fa:16:3e:5f:99:6c"],["iface-id","210af4c8-f369-4d4c-8082-46227be5b2f5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:09:07.480444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95efc1a2-ee8a-481a-bddc-562c99b55bcf","old",null,["set",[]],null],["","new","qr-210af4c8-f3",38,["map",[["attached-mac","fa:16:3e:5f:99:6c"],["iface-id","210af4c8-f369-4d4c-8082-46227be5b2f5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:09:07.524254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[837e9422-543b-4a9d-a0af-063e68f287fb]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:09:07.524851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:636 - agent port security group processed in 0.098 Oct 09 01:09:07.525526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 1693fd7c-438d-4b90-bf3e-c04814a09b2c to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:07.694370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['1693fd7c-438d-4b90-bf3e-c04814a09b2c'] and devices down [] completed. Oct 09 01:09:07.694692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:636 - ports processed. Elapsed:0.278 Oct 09 01:09:07.695139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:636 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.278 Oct 09 01:09:09.418296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:637 started Oct 09 01:09:09.420767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=742000000,duration_sec=1291,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:09.421392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:09.422314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:637 - starting polling. Elapsed:0.004 Oct 09 01:09:09.424093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:09.426504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:637 - port information retrieved. Elapsed:0.008 Oct 09 01:09:09.426828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6', '1693fd7c-438d-4b90-bf3e-c04814a09b2c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', '210af4c8-f369-4d4c-8082-46227be5b2f5', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': {'210af4c8-f369-4d4c-8082-46227be5b2f5'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:09:09.427443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '210af4c8-f369-4d4c-8082-46227be5b2f5', 'device_id': '8990c51a-b997-4bc6-ad41-d1bae89dcc72', 'network_id': '9199d184-92ab-49f4-b12a-13fa943db117', 'port_id': '210af4c8-f369-4d4c-8082-46227be5b2f5', 'mac_address': 'fa:16:3e:5f:99:6c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6cca7a80-2d7a-4c08-8a93-f46ecf74540f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:09.430792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 210af4c8-f369-4d4c-8082-46227be5b2f5 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:09.431167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 210af4c8-f369-4d4c-8082-46227be5b2f5 updated. Details: {'device': '210af4c8-f369-4d4c-8082-46227be5b2f5', 'device_id': '8990c51a-b997-4bc6-ad41-d1bae89dcc72', 'network_id': '9199d184-92ab-49f4-b12a-13fa943db117', 'port_id': '210af4c8-f369-4d4c-8082-46227be5b2f5', 'mac_address': 'fa:16:3e:5f:99:6c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6cca7a80-2d7a-4c08-8a93-f46ecf74540f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Oct 09 01:09:09.432598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-210af4c8-f3, col_values=(('tag', 14),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:09.433034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-210af4c8-f3, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:09.433543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-210af4c8-f3, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:09.440321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-210af4c8-f3, col_values=(('other_config', {'net_uuid': '9199d184-92ab-49f4-b12a-13fa943db117', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '660'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:09.452452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1c2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:09.452803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:637 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.026 Oct 09 01:09:09.453484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing device filters for 1 new devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 09 01:09:09.453484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Preparing filters for devices {'210af4c8-f369-4d4c-8082-46227be5b2f5'} Oct 09 01:09:09.454574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:09:09.454857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:09:09.457805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:09:09.495417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec422e2f-57bb-4dca-b201-c00fac03011d]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:09:09.496094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:637 - agent port security group processed in 0.069 Oct 09 01:09:09.496779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 210af4c8-f369-4d4c-8082-46227be5b2f5 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:09.692736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['210af4c8-f369-4d4c-8082-46227be5b2f5'] and devices down [] completed. Oct 09 01:09:09.693090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:637 - ports processed. Elapsed:0.275 Oct 09 01:09:09.693464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:637 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.275 Oct 09 01:09:09.753970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Resource Port 210af4c8-f369-4d4c-8082-46227be5b2f5 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107274) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 09 01:09:09.754356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-3cc2e847-ba5c-4842-9910-21a4ef5be62f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-389535'] for Port (210af4c8-f369-4d4c-8082-46227be5b2f5), after_update {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:11.419452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:638 started Oct 09 01:09:11.423574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=744000000,duration_sec=1293,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:11.424170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:11.424539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:638 - starting polling. Elapsed:0.005 Oct 09 01:09:11.426291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:09:11.428460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:638 - port information retrieved. Elapsed:0.009 Oct 09 01:09:11.428782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '2e3d988c-dd60-42c0-b5ee-878212bb71f6', '1693fd7c-438d-4b90-bf3e-c04814a09b2c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', '210af4c8-f369-4d4c-8082-46227be5b2f5', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': set(), 'updated': {'210af4c8-f369-4d4c-8082-46227be5b2f5'}, 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:09:11.429343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Returning: {'device': '210af4c8-f369-4d4c-8082-46227be5b2f5', 'device_id': '8990c51a-b997-4bc6-ad41-d1bae89dcc72', 'network_id': '9199d184-92ab-49f4-b12a-13fa943db117', 'port_id': '210af4c8-f369-4d4c-8082-46227be5b2f5', 'mac_address': 'fa:16:3e:5f:99:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6cca7a80-2d7a-4c08-8a93-f46ecf74540f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107274) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 09 01:09:11.431396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing port: 210af4c8-f369-4d4c-8082-46227be5b2f5 {{(pid=107274) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 09 01:09:11.431743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 210af4c8-f369-4d4c-8082-46227be5b2f5 updated. Details: {'device': '210af4c8-f369-4d4c-8082-46227be5b2f5', 'device_id': '8990c51a-b997-4bc6-ad41-d1bae89dcc72', 'network_id': '9199d184-92ab-49f4-b12a-13fa943db117', 'port_id': '210af4c8-f369-4d4c-8082-46227be5b2f5', 'mac_address': 'fa:16:3e:5f:99:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 660, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6cca7a80-2d7a-4c08-8a93-f46ecf74540f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Oct 09 01:09:11.432727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-210af4c8-f3, col_values=(('tag', 14),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:11.433148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-210af4c8-f3, column=vlan_mode) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:11.433554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-210af4c8-f3, column=trunks) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:11.433990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:11.434727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-210af4c8-f3, col_values=(('other_config', {'net_uuid': '9199d184-92ab-49f4-b12a-13fa943db117', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '660', 'tag': '14'}),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:09:11.435394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 09 01:09:11.437475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f1c6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:11.438440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:638 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.009 Oct 09 01:09:11.438782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refreshing firewall for 1 devices {{(pid=107274) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 09 01:09:11.439067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Refresh firewall rules Oct 09 01:09:11.440213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information for ports dict_keys([]) {{(pid=107274) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 09 01:09:11.440494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Update security group information {{(pid=107274) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 09 01:09:11.443518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 2 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:09:11.481174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5de50-4320-48fb-80f3-51ac49d0e96c]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:09:11.481781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:638 - agent port security group processed in 0.053 Oct 09 01:09:11.482491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Setting status for 210af4c8-f369-4d4c-8082-46227be5b2f5 to UP {{(pid=107274) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 09 01:09:11.613217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up ['210af4c8-f369-4d4c-8082-46227be5b2f5'] and devices down [] completed. Oct 09 01:09:11.613534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:638 - ports processed. Elapsed:0.194 Oct 09 01:09:11.613868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:638 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.195 Oct 09 01:09:13.420604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:639 started Oct 09 01:09:13.423437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=744000000,duration_sec=1295,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:13.424084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:13.424446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:639 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:15.422317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:640 started Oct 09 01:09:15.424717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=746000000,duration_sec=1297,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:15.425275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:15.425626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:640 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:17.422575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:641 started Oct 09 01:09:17.424980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=746000000,duration_sec=1299,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:17.425541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:17.425917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:641 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:19.423672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:642 started Oct 09 01:09:19.426036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=747000000,duration_sec=1301,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:19.426590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:19.426937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:642 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:21.425135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:643 started Oct 09 01:09:21.427578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=748000000,duration_sec=1303,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:21.428163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:21.428519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:643 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:23.426562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:644 started Oct 09 01:09:23.429605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=750000000,duration_sec=1305,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:23.430163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:23.430511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:644 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:25.427930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:645 started Oct 09 01:09:25.430929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=752000000,duration_sec=1307,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:25.431496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:25.431878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:645 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:27.428573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:646 started Oct 09 01:09:27.431687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=753000000,duration_sec=1309,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:27.432273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:27.432628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:646 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:29.429737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:647 started Oct 09 01:09:29.432090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=753000000,duration_sec=1311,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:29.432647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:29.432996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:647 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:31.430934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:648 started Oct 09 01:09:31.433371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=754000000,duration_sec=1313,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:31.433932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:31.434304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:648 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:33.432108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:649 started Oct 09 01:09:33.435024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=755000000,duration_sec=1315,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:33.435610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:33.435968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:649 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:35.433384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:650 started Oct 09 01:09:35.435961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=757000000,duration_sec=1317,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:35.436523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:35.436872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:650 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:37.434932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:651 started Oct 09 01:09:37.437263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=758000000,duration_sec=1319,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:37.437819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:37.438166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:651 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:39.435475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:652 started Oct 09 01:09:39.442155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=759000000,duration_sec=1321,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:39.442724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:39.443071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:652 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:09:41.436122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:653 started Oct 09 01:09:41.438455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=759000000,duration_sec=1323,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:41.439018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:41.439378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:653 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:43.437212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:654 started Oct 09 01:09:43.439622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=761000000,duration_sec=1325,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:43.440208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:43.440559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:654 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:45.438640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:655 started Oct 09 01:09:45.441051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=762000000,duration_sec=1327,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:45.441606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:45.441956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:655 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:47.439321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:656 started Oct 09 01:09:47.441667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=763000000,duration_sec=1329,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:47.442224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:47.442574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:656 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:49.440552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:657 started Oct 09 01:09:49.443312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=764000000,duration_sec=1331,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:49.443906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:49.444255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:657 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:51.441416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:658 started Oct 09 01:09:51.443860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=765000000,duration_sec=1333,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:51.444426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:51.444778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:658 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:09:53.442679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:659 started Oct 09 01:09:53.445000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=766000000,duration_sec=1335,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:53.445557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:53.445906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:659 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:55.443439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:660 started Oct 09 01:09:55.445769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=767000000,duration_sec=1337,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:55.446320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:55.446669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:660 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:57.445015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:661 started Oct 09 01:09:57.447363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=768000000,duration_sec=1339,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:57.447974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:57.448328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:661 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:09:59.445631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:662 started Oct 09 01:09:59.448007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=769000000,duration_sec=1341,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:09:59.448565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:09:59.448911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:662 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:01.446978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:663 started Oct 09 01:10:01.449424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=770000000,duration_sec=1343,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:01.449986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:01.450339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:663 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:03.448095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:664 started Oct 09 01:10:03.450403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=771000000,duration_sec=1345,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:03.450958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:03.451310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:664 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:05.448993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:665 started Oct 09 01:10:05.451899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=772000000,duration_sec=1347,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:05.452973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:05.453319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:665 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:07.450044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:666 started Oct 09 01:10:07.452890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f1fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=773000000,duration_sec=1349,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:07.453446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:07.453793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:666 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:09.451357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:667 started Oct 09 01:10:09.453851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f200,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=775000000,duration_sec=1351,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:09.454410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:09.454760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:667 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:11.452505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:668 started Oct 09 01:10:11.455893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f202,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=776000000,duration_sec=1353,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:11.456751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:11.457284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:668 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:10:13.453610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:669 started Oct 09 01:10:13.456558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f204,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=778000000,duration_sec=1355,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:13.457116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:13.457466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:669 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:15.455058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:670 started Oct 09 01:10:15.457440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f206,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=778000000,duration_sec=1357,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:15.458005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:15.458359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:670 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:17.456359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:671 started Oct 09 01:10:17.458662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f208,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=780000000,duration_sec=1359,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:17.459222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:17.459574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:671 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:19.457029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:672 started Oct 09 01:10:19.459427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f20a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=780000000,duration_sec=1361,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:19.460035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:19.460391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:672 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:21.222230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroup deleted: 01d80b84-51cc-4919-9308-5922e4085615 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.222875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (01d80b84-51cc-4919-9308-5922e4085615), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.223043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('01d80b84-51cc-4919-9308-5922e4085615',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:10:21.242365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('01d80b84-51cc-4919-9308-5922e4085615',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:10:21.242798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroupRule deleted: 883d450e-a0fb-48ca-b9fe-74134435e1cd {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.243171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (883d450e-a0fb-48ca-b9fe-74134435e1cd), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.243529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:10:21.243973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroupRule deleted: fc2da4b0-f5f9-4a88-af79-d1a820270dc2 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.244335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (fc2da4b0-f5f9-4a88-af79-d1a820270dc2), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.244655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:10:21.245048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroupRule deleted: 5328f75f-9c3b-4e5c-b2b9-519280c55f2d {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.245387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5328f75f-9c3b-4e5c-b2b9-519280c55f2d), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.245731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:10:21.246098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroupRule deleted: ef325899-405e-4c56-b95d-1882d1651acf {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.246438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (ef325899-405e-4c56-b95d-1882d1651acf), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.246753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:10:21.247351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroupRule deleted: 4595d252-d1c9-4715-b016-212b2e846fad {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.248048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (4595d252-d1c9-4715-b016-212b2e846fad), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.248048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:10:21.248392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroupRule deleted: b8093d1a-61dc-4493-982f-6215f97d1289 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.248854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b8093d1a-61dc-4493-982f-6215f97d1289), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.249175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:10:21.249540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroupRule deleted: 6cdcf08c-b99d-4f5c-a46e-a8a384802eed {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.250164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (6cdcf08c-b99d-4f5c-a46e-a8a384802eed), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.250485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:10:21.250936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Resource SecurityGroupRule deleted: 01552807-3f6b-4244-ad2b-e594e90dc06f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:21.251275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (01552807-3f6b-4244-ad2b-e594e90dc06f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:21.251756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-74f84d47-1539-44cc-b665-2840384aaf9c tempest-TestShelveInstance-710885321 tempest-TestShelveInstance-710885321-project] Security group rule updated ['01d80b84-51cc-4919-9308-5922e4085615'] Oct 09 01:10:21.457647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:673 started Oct 09 01:10:21.460209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f20c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=781000000,duration_sec=1363,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:21.460878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:21.461294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:673 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:22.105600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-c591826d-ad7d-4fa8-8e89-000ed5f88cd8 admin admin] Resource Port deleted: 2e3d988c-dd60-42c0-b5ee-878212bb71f6 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:22.106376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-c591826d-ad7d-4fa8-8e89-000ed5f88cd8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (2e3d988c-dd60-42c0-b5ee-878212bb71f6), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:23.288911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7821bc5b-305d-430f-960a-09b26e88eee8","delete","qr-2e3d988c-dd",36,["map",[["attached-mac","fa:16:3e:55:07:bc"],["iface-id","2e3d988c-dd60-42c0-b5ee-878212bb71f6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:10:23.345213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-436a20a4-21e2-436f-8ed4-484c321e90aa admin admin] Resource Port deleted: f444d59a-9b81-400a-b7ab-85e0d74fa75b {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:23.345597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-436a20a4-21e2-436f-8ed4-484c321e90aa admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (f444d59a-9b81-400a-b7ab-85e0d74fa75b), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:23.458690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:674 started Oct 09 01:10:23.592321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f20e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=911000000,duration_sec=1365,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:23.593120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:23.593372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:674 - starting polling. Elapsed:0.135 Oct 09 01:10:23.595585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:23.598243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f444d59a-9b, col_values=(('tag', 4095),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:10:23.608934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f210,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:23.609659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['f444d59a-9b81-400a-b7ab-85e0d74fa75b'] Oct 09 01:10:23.611619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:10:23.661779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7da9d20-1770-48b4-b409-238f670ddc12]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:10:23.666511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f212,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:23.666881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:674 - port information retrieved. Elapsed:0.208 Oct 09 01:10:23.667213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '1693fd7c-438d-4b90-bf3e-c04814a09b2c', '8909d97f-c5e3-462a-9bad-225ac2909771', 'f444d59a-9b81-400a-b7ab-85e0d74fa75b', '25cba434-73ae-44ab-aa76-d477a015b1c7', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9', '6fc925b8-cc04-47c9-908d-92ab057747b2', '210af4c8-f369-4d4c-8082-46227be5b2f5', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': {'2e3d988c-dd60-42c0-b5ee-878212bb71f6'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:10:23.667574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:674 - agent port security group processed in 0.000 Oct 09 01:10:23.669153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:10:23.669460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'2e3d988c-dd60-42c0-b5ee-878212bb71f6'} Oct 09 01:10:23.669888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:10:23.717959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d045ed-9752-487e-bc64-dabf4db959a2]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:10:23.718565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'2e3d988c-dd60-42c0-b5ee-878212bb71f6'} removed Oct 09 01:10:23.748352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:10:23.749067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:674 - treat_devices_removed completed in 0.080 Oct 09 01:10:23.749592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:674 - ports processed. Elapsed:0.291 Oct 09 01:10:23.750135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:674 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.292 Oct 09 01:10:23.812313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-dc095a3b-62b3-40cf-8853-abe36160f172 admin admin] Resource Subnet deleted: 16487830-47c2-4172-aeb2-afd8c04c19f1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:23.812679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-dc095a3b-62b3-40cf-8853-abe36160f172 admin admin] Publish callbacks [] for Subnet (16487830-47c2-4172-aeb2-afd8c04c19f1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:23.954691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["edf3346f-1aef-4582-a51c-39c935ebec49","delete","tapc13661b4-9e",33,["map",[["attached-mac","fa:16:3e:2f:1c:3b"],["iface-id","c13661b4-9ee4-4b24-a8ad-28d21d7f80b9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:10:23.967821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c8e7b2e3-a7ed-4a49-b177-7aacdc4ab698","delete","qg-f444d59a-9b",34,["map",[["attached-mac","fa:16:3e:3e:96:3e"],["iface-id","f444d59a-9b81-400a-b7ab-85e0d74fa75b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:10:24.141593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4b4b432e-b1b9-4b63-813f-7dbb4c537d9e admin admin] Resource Port deleted: c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:24.141974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4b4b432e-b1b9-4b63-813f-7dbb4c537d9e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (c13661b4-9ee4-4b24-a8ad-28d21d7f80b9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:24.233286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-533370ce-6a50-45fb-976f-807e61509e92 None None] Resource Port deleted: c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:24.233809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-533370ce-6a50-45fb-976f-807e61509e92 None None] Skipped duplicate delete event for c13661b4-9ee4-4b24-a8ad-28d21d7f80b9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 09 01:10:24.373759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-4b4b432e-b1b9-4b63-813f-7dbb4c537d9e admin admin] Resource Network deleted: b61dd093-5d2d-4770-aeef-41797121c0d3 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:24.374351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-4b4b432e-b1b9-4b63-813f-7dbb4c537d9e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (b61dd093-5d2d-4770-aeef-41797121c0d3), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:25.183550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-f65620a1-72b2-401e-b722-3fa1c3703700 admin admin] Resource Port deleted: 210af4c8-f369-4d4c-8082-46227be5b2f5 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:25.183967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-f65620a1-72b2-401e-b722-3fa1c3703700 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (210af4c8-f369-4d4c-8082-46227be5b2f5), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:25.460231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:675 started Oct 09 01:10:25.462827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f214,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=784000000,duration_sec=1367,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:25.463407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:25.463894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:675 - starting polling. Elapsed:0.004 Oct 09 01:10:25.465402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:25.467893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-210af4c8-f3, col_values=(('tag', 4095),)) {{(pid=107274) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 09 01:10:25.474245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f216,OFPFlowMod(buffer_id=4294967295,command=0,cookie=9214758823016176915,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:25.474633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for ['210af4c8-f369-4d4c-8082-46227be5b2f5'] Oct 09 01:10:25.475090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:10:25.513575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb4f1a-91eb-4c07-8c37-386e6a22a65a]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:10:25.517309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f218,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:25.518975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f21a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:25.519291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:675 - port information retrieved. Elapsed:0.059 Oct 09 01:10:25.519642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '1693fd7c-438d-4b90-bf3e-c04814a09b2c', '8909d97f-c5e3-462a-9bad-225ac2909771', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', '210af4c8-f369-4d4c-8082-46227be5b2f5', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': {'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:10:25.519972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:675 - agent port security group processed in 0.000 Oct 09 01:10:25.521281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:10:25.521581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'} Oct 09 01:10:25.521916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port f444d59a-9b81-400a-b7ab-85e0d74fa75b is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:10:25.522333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 4 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:10:25.560722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5adf35-9f7c-4df4-a7ac-d685aa49c482]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:10:25.561316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'f444d59a-9b81-400a-b7ab-85e0d74fa75b', 'c13661b4-9ee4-4b24-a8ad-28d21d7f80b9'} removed Oct 09 01:10:25.610808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:10:25.611223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:10:25.611633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 13 from net-id = b61dd093-5d2d-4770-aeef-41797121c0d3, seg-id = 657 Oct 09 01:10:25.614198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da184f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:25.616611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363f21c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4753}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:25.616928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:675 - treat_devices_removed completed in 0.095 Oct 09 01:10:25.617216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:675 - ports processed. Elapsed:0.157 Oct 09 01:10:25.617540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:675 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.158 Oct 09 01:10:26.436166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-ec0e37c7-9771-4670-ae30-a7bf450c22b9 admin admin] Resource Port deleted: 1693fd7c-438d-4b90-bf3e-c04814a09b2c {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:26.436628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-ec0e37c7-9771-4670-ae30-a7bf450c22b9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (1693fd7c-438d-4b90-bf3e-c04814a09b2c), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:26.536271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95efc1a2-ee8a-481a-bddc-562c99b55bcf","delete","qr-210af4c8-f3",38,["map",[["attached-mac","fa:16:3e:5f:99:6c"],["iface-id","210af4c8-f369-4d4c-8082-46227be5b2f5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:10:26.883459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-1244cef7-0a34-4661-8cc9-1e4b522ad3fc admin admin] Resource Subnet deleted: 6cca7a80-2d7a-4c08-8a93-f46ecf74540f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:26.883986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-1244cef7-0a34-4661-8cc9-1e4b522ad3fc admin admin] Publish callbacks [] for Subnet (6cca7a80-2d7a-4c08-8a93-f46ecf74540f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:26.950806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a05f130e-51d1-4919-aa6a-9406302195df","delete","qg-1693fd7c-43",37,["map",[["attached-mac","fa:16:3e:c0:3e:18"],["iface-id","1693fd7c-438d-4b90-bf3e-c04814a09b2c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:10:27.019367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21b768cb-0b0c-427d-ad38-0b4fd86ea950","delete","tap6ebc715b-f5",35,["map",[["attached-mac","fa:16:3e:61:f4:31"],["iface-id","6ebc715b-f504-4d86-894f-3858c5ca3ba1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107274) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 09 01:10:27.199847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-73f7030b-8fc1-45fd-9fc3-db9bc79f058a admin admin] Resource Port deleted: 6ebc715b-f504-4d86-894f-3858c5ca3ba1 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:27.200233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-73f7030b-8fc1-45fd-9fc3-db9bc79f058a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-389520'] for Port (6ebc715b-f504-4d86-894f-3858c5ca3ba1), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:27.446010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-73f7030b-8fc1-45fd-9fc3-db9bc79f058a admin admin] Resource Network deleted: 9199d184-92ab-49f4-b12a-13fa943db117 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:27.446546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-73f7030b-8fc1-45fd-9fc3-db9bc79f058a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-447058'] for Network (9199d184-92ab-49f4-b12a-13fa943db117), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:27.461109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:676 started Oct 09 01:10:27.463877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f21e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=785000000,duration_sec=1369,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:27.465064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:27.465562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:676 - starting polling. Elapsed:0.005 Oct 09 01:10:27.466808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-335509'] for ovsdb (None), after_read {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:27.470097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f220,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:27.472150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f222,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:27.474038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x363f224,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:27.474526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:676 - port information retrieved. Elapsed:0.014 Oct 09 01:10:27.474852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Starting to process devices in:{'current': {'8909d97f-c5e3-462a-9bad-225ac2909771', '25cba434-73ae-44ab-aa76-d477a015b1c7', '6fc925b8-cc04-47c9-908d-92ab057747b2', 'a976c1aa-1777-4766-a2b3-029491ee66f7'}, 'added': set(), 'removed': {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '210af4c8-f369-4d4c-8082-46227be5b2f5', '1693fd7c-438d-4b90-bf3e-c04814a09b2c'}, 'updated': set(), 're_added': set()} {{(pid=107274) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 09 01:10:27.475179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:676 - agent port security group processed in 0.000 Oct 09 01:10:27.476215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Configuration for devices up [] and devices down [] completed. Oct 09 01:10:27.476515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Remove device filter for {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '210af4c8-f369-4d4c-8082-46227be5b2f5', '1693fd7c-438d-4b90-bf3e-c04814a09b2c'} Oct 09 01:10:27.476904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port 210af4c8-f369-4d4c-8082-46227be5b2f5 is not handled by the firewall. {{(pid=107274) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 09 01:10:27.477351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.common.ovs_lib [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Processing 8 OpenFlow rules. {{(pid=107274) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 09 01:10:27.528019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b04212-ca37-4007-a796-2efd34c72d88]: (4, ('', '', 0)) {{(pid=108976) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 09 01:10:27.528713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Ports {'6ebc715b-f504-4d86-894f-3858c5ca3ba1', '210af4c8-f369-4d4c-8082-46227be5b2f5', '1693fd7c-438d-4b90-bf3e-c04814a09b2c'} removed Oct 09 01:10:27.605324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Port removal failed for set() {{(pid=107274) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 09 01:10:27.605929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Reclaiming vlan = 14 from net-id = 9199d184-92ab-49f4-b12a-13fa943db117, seg-id = 660 Oct 09 01:10:27.609100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x32da1851,OFPFlowMod(buffer_id=4294967295,command=3,cookie=1503099881718125406,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:27.611543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x363f226,OFPFlowMod(buffer_id=4294967295,command=3,cookie=9214758823016176915,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4756}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:27.611971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] net_uuid None not managed by VLAN manager Oct 09 01:10:27.612419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] process_network_ports - iteration:676 - treat_devices_removed completed in 0.136 Oct 09 01:10:27.612704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:676 - ports processed. Elapsed:0.152 Oct 09 01:10:27.613179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:676 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.152 Oct 09 01:10:27.793035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Resource SecurityGroup deleted: bea7ab72-1f65-47e7-bcea-64ca18bb7f58 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:27.793623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (bea7ab72-1f65-47e7-bcea-64ca18bb7f58), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:27.794192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bea7ab72-1f65-47e7-bcea-64ca18bb7f58',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:10:27.807106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bea7ab72-1f65-47e7-bcea-64ca18bb7f58',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:10:27.807453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Resource SecurityGroupRule deleted: 5c2446ed-010e-407b-945f-78ada5423cb8 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:27.807887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (5c2446ed-010e-407b-945f-78ada5423cb8), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:27.808225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Security group rule updated ['bea7ab72-1f65-47e7-bcea-64ca18bb7f58'] Oct 09 01:10:27.808620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Resource SecurityGroupRule deleted: 749aa59f-fb79-4fa9-b93f-72485da4bd86 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:27.808972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (749aa59f-fb79-4fa9-b93f-72485da4bd86), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:27.809344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Security group rule updated ['bea7ab72-1f65-47e7-bcea-64ca18bb7f58'] Oct 09 01:10:27.809724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Resource SecurityGroupRule deleted: abc0a1ac-da3a-4036-a123-72c2b38f19ee {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:27.810072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (abc0a1ac-da3a-4036-a123-72c2b38f19ee), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:27.810396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Security group rule updated ['bea7ab72-1f65-47e7-bcea-64ca18bb7f58'] Oct 09 01:10:27.810765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Resource SecurityGroupRule deleted: d47a8eba-91cb-4445-a06a-24d53639b570 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:27.811136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (d47a8eba-91cb-4445-a06a-24d53639b570), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:27.811452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-08a4fb70-757b-4e39-9afd-373aba34ebd2 admin admin] Security group rule updated ['bea7ab72-1f65-47e7-bcea-64ca18bb7f58'] Oct 09 01:10:28.291650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Resource SecurityGroup deleted: e4c98132-a3ae-485b-b3d0-cd9f5b52570e {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:28.292104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-389627'] for SecurityGroup (e4c98132-a3ae-485b-b3d0-cd9f5b52570e), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:28.292553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e4c98132-a3ae-485b-b3d0-cd9f5b52570e',)}} {{(pid=107274) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 09 01:10:28.307183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e4c98132-a3ae-485b-b3d0-cd9f5b52570e',)))} {{(pid=107274) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 09 01:10:28.307575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Resource SecurityGroupRule deleted: 101620f9-e725-4668-bbcb-c5d038965bda {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:28.307981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (101620f9-e725-4668-bbcb-c5d038965bda), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:28.309081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Security group rule updated ['e4c98132-a3ae-485b-b3d0-cd9f5b52570e'] Oct 09 01:10:28.309646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Resource SecurityGroupRule deleted: 1938e51c-edd9-4b5e-88c3-847a058b9249 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:28.310210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (1938e51c-edd9-4b5e-88c3-847a058b9249), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:28.310530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Security group rule updated ['e4c98132-a3ae-485b-b3d0-cd9f5b52570e'] Oct 09 01:10:28.310894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Resource SecurityGroupRule deleted: 3fe0a0cc-649f-47da-8741-39e2b796a2f9 {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:28.311443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (3fe0a0cc-649f-47da-8741-39e2b796a2f9), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:28.312003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Security group rule updated ['e4c98132-a3ae-485b-b3d0-cd9f5b52570e'] Oct 09 01:10:28.312644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.resource_cache [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Resource SecurityGroupRule deleted: b93fa27e-57aa-4ba4-a1ac-23cf017d866f {{(pid=107274) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 09 01:10:28.312983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron_lib.callbacks.manager [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-389602'] for SecurityGroupRule (b93fa27e-57aa-4ba4-a1ac-23cf017d866f), after_delete {{(pid=107274) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 09 01:10:28.313373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.agent.securitygroups_rpc [None req-192c8b38-ce11-4c31-bc61-8e559a9b2930 admin admin] Security group rule updated ['e4c98132-a3ae-485b-b3d0-cd9f5b52570e'] Oct 09 01:10:29.462367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:677 started Oct 09 01:10:29.464841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f228,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=786000000,duration_sec=1371,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:29.465423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:29.465776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:677 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:31.463064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:678 started Oct 09 01:10:31.465459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f22a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=786000000,duration_sec=1373,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:31.466025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:31.466379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:678 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:33.464433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:679 started Oct 09 01:10:33.467006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f22c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=788000000,duration_sec=1375,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:33.467567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:33.467951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:679 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:35.465903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:680 started Oct 09 01:10:35.468269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f22e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=789000000,duration_sec=1377,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:35.468855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:35.469217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:680 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:37.467013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:681 started Oct 09 01:10:37.469887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f230,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=790000000,duration_sec=1379,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:37.470454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:37.470799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:681 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:39.467846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:682 started Oct 09 01:10:39.471152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f232,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=791000000,duration_sec=1381,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:39.471750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:39.472107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:682 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:41.469338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:683 started Oct 09 01:10:41.471740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f234,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=793000000,duration_sec=1383,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:41.472301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:41.472653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:683 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:43.470562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:684 started Oct 09 01:10:43.473263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f236,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=794000000,duration_sec=1385,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:43.473835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:43.474189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:684 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:45.472332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:685 started Oct 09 01:10:45.474673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f238,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=796000000,duration_sec=1387,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:45.475235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:45.475585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:685 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:47.473808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:686 started Oct 09 01:10:47.476719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f23a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=797000000,duration_sec=1389,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:47.477365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:47.477837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:686 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:49.474905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:687 started Oct 09 01:10:49.477320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f23c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=798000000,duration_sec=1391,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:49.477893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:49.478245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:687 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:51.475492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:688 started Oct 09 01:10:51.477901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f23e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=799000000,duration_sec=1393,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:51.478468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:51.478823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:688 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:53.476109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:689 started Oct 09 01:10:53.478427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f240,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=799000000,duration_sec=1395,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:53.478983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:53.479336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:689 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:10:55.477441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:690 started Oct 09 01:10:55.479949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f242,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=801000000,duration_sec=1397,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:55.480535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:55.480886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:690 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:57.478573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:691 started Oct 09 01:10:57.481164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f244,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=802000000,duration_sec=1399,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:57.481736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:57.482089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:691 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:10:59.479057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:692 started Oct 09 01:10:59.481386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f246,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=802000000,duration_sec=1401,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:10:59.481949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:10:59.482321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:692 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:01.480246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:693 started Oct 09 01:11:01.482574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f248,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=804000000,duration_sec=1403,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:01.483132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:01.483478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:693 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:03.481495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:694 started Oct 09 01:11:03.483816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f24a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=805000000,duration_sec=1405,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:03.484370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:03.484713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:694 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:05.482179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:695 started Oct 09 01:11:05.484617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f24c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=806000000,duration_sec=1407,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:05.485197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:05.485553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:695 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:07.483061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:696 started Oct 09 01:11:07.485386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f24e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=806000000,duration_sec=1409,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:07.485950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:07.486302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:696 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:09.484479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:697 started Oct 09 01:11:09.486815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f250,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=808000000,duration_sec=1411,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:09.487369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:09.487742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:697 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:11.485814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:698 started Oct 09 01:11:11.488724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f252,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=809000000,duration_sec=1413,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:11.489279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:11.489626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:698 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:13.486711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:699 started Oct 09 01:11:13.489568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f254,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=810000000,duration_sec=1415,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:13.490127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:13.490478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:699 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:15.488094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:700 started Oct 09 01:11:15.490500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f256,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=811000000,duration_sec=1417,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:15.491068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:15.491423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:700 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:17.488935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:701 started Oct 09 01:11:17.491289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f258,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=812000000,duration_sec=1419,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:17.491880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:17.492256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:701 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:19.490463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:702 started Oct 09 01:11:19.492854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f25a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=814000000,duration_sec=1421,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:19.493415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:19.493764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:702 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:21.492056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:703 started Oct 09 01:11:21.494737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f25c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=816000000,duration_sec=1423,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:21.495295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:21.495695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:703 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:23.493191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:704 started Oct 09 01:11:23.495492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f25e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=816000000,duration_sec=1425,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:23.496079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:23.496419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:704 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:25.494389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:705 started Oct 09 01:11:25.497051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f260,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=818000000,duration_sec=1427,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:25.497612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:25.497963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:705 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:27.495822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:706 started Oct 09 01:11:27.498228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f262,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=819000000,duration_sec=1429,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:27.498789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:27.499142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:706 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:29.497150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:707 started Oct 09 01:11:29.499471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f264,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=820000000,duration_sec=1431,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:29.500064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:29.500416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:707 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:31.498753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:708 started Oct 09 01:11:31.501354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f266,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=822000000,duration_sec=1433,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:31.501913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:31.502264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:708 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:33.499681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:709 started Oct 09 01:11:33.501995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f268,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=823000000,duration_sec=1435,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:33.502554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:33.502904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:709 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:35.500742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:710 started Oct 09 01:11:35.503088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f26a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=824000000,duration_sec=1437,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:35.504246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:35.504608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:710 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:37.502260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:711 started Oct 09 01:11:37.505016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f26c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=826000000,duration_sec=1439,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:37.505582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:37.505930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:711 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:39.503896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:712 started Oct 09 01:11:39.506192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f26e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=827000000,duration_sec=1441,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:39.506748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:39.507097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:712 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:41.504781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:713 started Oct 09 01:11:41.507423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f270,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=828000000,duration_sec=1443,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:41.508027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:41.508373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:713 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:43.506189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:714 started Oct 09 01:11:43.508561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f272,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=829000000,duration_sec=1445,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:43.509124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:43.509471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:714 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:45.507561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:715 started Oct 09 01:11:45.509942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f274,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=831000000,duration_sec=1447,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:45.510502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:45.510851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:715 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:47.508965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:716 started Oct 09 01:11:47.511334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f276,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=832000000,duration_sec=1449,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:47.511925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:47.512272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:716 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:49.510091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:717 started Oct 09 01:11:49.512536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f278,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=833000000,duration_sec=1451,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:49.513133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:49.513489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:717 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:51.511495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:718 started Oct 09 01:11:51.513889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f27a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=835000000,duration_sec=1453,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:51.514458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:51.514808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:718 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:53.512584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:719 started Oct 09 01:11:53.514937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f27c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=836000000,duration_sec=1455,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:53.515499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:53.515879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:719 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:11:55.513385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:720 started Oct 09 01:11:55.515816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f27e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=837000000,duration_sec=1457,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:55.516406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:55.516754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:720 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:57.514045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:721 started Oct 09 01:11:57.516466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f280,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=837000000,duration_sec=1459,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:57.517018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:57.517363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:721 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:11:59.514802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:722 started Oct 09 01:11:59.517182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f282,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=838000000,duration_sec=1461,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:11:59.517775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:11:59.518150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:722 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:01.515839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:723 started Oct 09 01:12:01.518230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f284,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=839000000,duration_sec=1463,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:01.519306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:01.519691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:723 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:03.517205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:724 started Oct 09 01:12:03.519668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f286,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=841000000,duration_sec=1465,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:03.520229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:03.520580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:724 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:05.518229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:725 started Oct 09 01:12:05.520714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f288,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=842000000,duration_sec=1467,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:05.521278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:05.521623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:725 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:07.519779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:726 started Oct 09 01:12:07.522080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f28a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=843000000,duration_sec=1469,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:07.522631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:07.522978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:726 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:09.520596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:727 started Oct 09 01:12:09.522898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f28c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=844000000,duration_sec=1471,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:09.523457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:09.523838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:727 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:11.521556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:728 started Oct 09 01:12:11.523950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f28e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=845000000,duration_sec=1473,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:11.524506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:11.524856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:728 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:13.522165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:729 started Oct 09 01:12:13.524526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f290,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=845000000,duration_sec=1475,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:13.525084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:13.525431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:729 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:15.523490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:730 started Oct 09 01:12:15.525986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f292,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=847000000,duration_sec=1477,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:15.526552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:15.526905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:730 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:17.524486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:731 started Oct 09 01:12:17.526851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f294,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=848000000,duration_sec=1479,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:17.527419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:17.527798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:731 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:19.525693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:732 started Oct 09 01:12:19.528264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f296,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=849000000,duration_sec=1481,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:19.528835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:19.529192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:732 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:21.527113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:733 started Oct 09 01:12:21.529487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f298,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=850000000,duration_sec=1483,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:21.530084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:21.530436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:733 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:23.528514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:734 started Oct 09 01:12:23.531221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f29a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=852000000,duration_sec=1485,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:23.531811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:23.532188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:734 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:25.529112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:735 started Oct 09 01:12:25.531471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f29c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=852000000,duration_sec=1487,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:25.532049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:25.532400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:735 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:27.529982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:736 started Oct 09 01:12:27.532353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f29e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=853000000,duration_sec=1489,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:27.532911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:27.533263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:736 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:29.530568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:737 started Oct 09 01:12:29.532946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=854000000,duration_sec=1491,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:29.533508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:29.533883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:737 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:31.531458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:738 started Oct 09 01:12:31.534113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=855000000,duration_sec=1493,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:31.534699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:31.535050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:738 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:33.532636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:739 started Oct 09 01:12:33.534914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=856000000,duration_sec=1495,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:33.535462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:33.535834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:739 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:35.533786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:740 started Oct 09 01:12:35.536178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=857000000,duration_sec=1497,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:35.536999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:35.537343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:740 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:37.534579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:741 started Oct 09 01:12:37.537241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=858000000,duration_sec=1499,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:37.538321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:37.538669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:741 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:39.535641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:742 started Oct 09 01:12:39.538299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=859000000,duration_sec=1501,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:39.538893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:39.539245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:742 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:41.536106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:743 started Oct 09 01:12:41.538745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=860000000,duration_sec=1503,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:41.539331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:41.539711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:743 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:43.536579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:744 started Oct 09 01:12:43.539797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=861000000,duration_sec=1505,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:43.540351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:43.540697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:744 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:45.537795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:745 started Oct 09 01:12:45.540211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=861000000,duration_sec=1507,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:45.540772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:45.541124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:745 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:47.538655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:746 started Oct 09 01:12:47.541008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=862000000,duration_sec=1509,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:47.541596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:47.541944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:746 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:49.539995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:747 started Oct 09 01:12:49.542464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=863000000,duration_sec=1511,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:49.543025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:49.543379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:747 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:51.541453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:748 started Oct 09 01:12:51.543847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=865000000,duration_sec=1513,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:51.544403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:51.544747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:748 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:53.542384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:749 started Oct 09 01:12:53.544762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=866000000,duration_sec=1515,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:53.545330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:53.545686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:749 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:55.543774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:750 started Oct 09 01:12:55.546148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=867000000,duration_sec=1517,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:55.546717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:55.547071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:750 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:12:57.544952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:751 started Oct 09 01:12:57.547357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=868000000,duration_sec=1519,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:57.547954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:57.548337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:751 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:12:59.546177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:752 started Oct 09 01:12:59.552977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=869000000,duration_sec=1521,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:12:59.553563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:12:59.553920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:752 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:13:01.547565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:753 started Oct 09 01:13:01.549945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=871000000,duration_sec=1523,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:01.550506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:01.550859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:753 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:03.548119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:754 started Oct 09 01:13:03.550453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=871000000,duration_sec=1525,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:03.551017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:03.551367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:754 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:05.548872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:755 started Oct 09 01:13:05.551383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=872000000,duration_sec=1527,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:05.551978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:05.552326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:755 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:07.550173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:756 started Oct 09 01:13:07.552521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=873000000,duration_sec=1529,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:07.553641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:07.553987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:756 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:09.551523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:757 started Oct 09 01:13:09.554513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=875000000,duration_sec=1531,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:09.555079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:09.555425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:757 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:11.552751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:758 started Oct 09 01:13:11.555132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=876000000,duration_sec=1533,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:11.555723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:11.556078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:758 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:13.554147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:759 started Oct 09 01:13:13.556576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=877000000,duration_sec=1535,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:13.557148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:13.557501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:759 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:15.555300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:760 started Oct 09 01:13:15.558048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=879000000,duration_sec=1537,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:15.558611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:15.558966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:760 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:17.556117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:761 started Oct 09 01:13:17.558555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=879000000,duration_sec=1539,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:17.559116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:17.559471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:761 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:19.556747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:762 started Oct 09 01:13:19.559104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=880000000,duration_sec=1541,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:19.559683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:19.560031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:762 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:21.557291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:763 started Oct 09 01:13:21.559740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=881000000,duration_sec=1543,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:21.560318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:21.560656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:763 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:23.557986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:764 started Oct 09 01:13:23.560378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=881000000,duration_sec=1545,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:23.560941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:23.561298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:764 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:25.558763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:765 started Oct 09 01:13:25.561251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=882000000,duration_sec=1547,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:25.561830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:25.562208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:765 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:27.559918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:766 started Oct 09 01:13:27.562330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=883000000,duration_sec=1549,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:27.562898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:27.563251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:766 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:29.561091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:767 started Oct 09 01:13:29.563488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=884000000,duration_sec=1551,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:29.564082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:29.564437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:767 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:31.561667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:768 started Oct 09 01:13:31.564120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=885000000,duration_sec=1553,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:31.564683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:31.565035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:768 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:33.562743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:769 started Oct 09 01:13:33.569489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=886000000,duration_sec=1555,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:33.570054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:33.570405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:769 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 09 01:13:35.563362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:770 started Oct 09 01:13:35.565775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=887000000,duration_sec=1557,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:35.566335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:35.566686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:770 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:37.564557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:771 started Oct 09 01:13:37.566922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=888000000,duration_sec=1559,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:37.567474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:37.567857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:771 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:39.565406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:772 started Oct 09 01:13:39.567823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=889000000,duration_sec=1561,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:39.568386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:39.568737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:772 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:41.566750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:773 started Oct 09 01:13:41.569195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=890000000,duration_sec=1563,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:41.569778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:41.570130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:773 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:43.567565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:774 started Oct 09 01:13:43.569964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=891000000,duration_sec=1565,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:43.570545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:43.570883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:774 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:45.568183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:775 started Oct 09 01:13:45.570579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=892000000,duration_sec=1567,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:45.571166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:45.571519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:775 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:47.568983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:776 started Oct 09 01:13:47.571667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=893000000,duration_sec=1569,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:47.572226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:47.572576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:776 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:49.569583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:777 started Oct 09 01:13:49.572363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=893000000,duration_sec=1571,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:49.572940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:49.573297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:777 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:51.570205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:778 started Oct 09 01:13:51.572561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=893000000,duration_sec=1573,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:51.573121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:51.573469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:778 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:53.571445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:779 started Oct 09 01:13:53.573824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=895000000,duration_sec=1575,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:53.574419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:53.574777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:779 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:13:55.572360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:780 started Oct 09 01:13:55.574757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=896000000,duration_sec=1577,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:55.575321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:55.575698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:780 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:57.573634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:781 started Oct 09 01:13:57.575996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=897000000,duration_sec=1579,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:57.576564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:57.576916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:781 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:13:59.574537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:782 started Oct 09 01:13:59.577001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=898000000,duration_sec=1581,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:13:59.577569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:13:59.577920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:782 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:01.575152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:783 started Oct 09 01:14:01.578086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=899000000,duration_sec=1583,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:01.578656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:01.579037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:783 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:03.575901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:784 started Oct 09 01:14:03.578887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f2fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=899000000,duration_sec=1585,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:03.579455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:03.579840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:784 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:05.576771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:785 started Oct 09 01:14:05.579197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f300,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=900000000,duration_sec=1587,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:05.579814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:05.580173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:785 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:07.577892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:786 started Oct 09 01:14:07.585308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f302,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=901000000,duration_sec=1589,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:07.585913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:07.586271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:786 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 09 01:14:09.578508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:787 started Oct 09 01:14:09.580933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f304,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=902000000,duration_sec=1591,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:09.581492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:09.581845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:787 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:11.579693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:788 started Oct 09 01:14:11.582079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f306,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=903000000,duration_sec=1593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:11.582686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:11.583039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:788 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:13.580645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:789 started Oct 09 01:14:13.583133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f308,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=904000000,duration_sec=1595,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:13.583750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:13.584109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:789 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:15.581464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:790 started Oct 09 01:14:15.584093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f30a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=905000000,duration_sec=1597,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:15.584522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:15.584903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:790 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:17.582697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:791 started Oct 09 01:14:17.585147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f30c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=906000000,duration_sec=1599,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:17.585712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:17.586064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:791 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:19.583488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:792 started Oct 09 01:14:19.586250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f30e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=907000000,duration_sec=1601,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:19.586810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:19.587170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:792 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:21.584977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:793 started Oct 09 01:14:21.587343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f310,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=908000000,duration_sec=1603,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:21.587925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:21.588278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:793 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:14:23.586253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:794 started Oct 09 01:14:23.588922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f312,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=910000000,duration_sec=1605,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:23.589480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:23.589834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:794 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:25.587185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:795 started Oct 09 01:14:25.590710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f314,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=911000000,duration_sec=1607,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:25.591327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:25.591746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:795 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:14:27.588214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:796 started Oct 09 01:14:27.590678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f316,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=912000000,duration_sec=1609,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:27.591212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:27.591569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:796 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:29.589326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:797 started Oct 09 01:14:29.591730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f318,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=913000000,duration_sec=1611,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:29.592325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:29.593313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:797 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:31.591228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:798 started Oct 09 01:14:31.594195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f31a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=915000000,duration_sec=1613,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:31.594752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:31.595100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:798 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:33.592588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:799 started Oct 09 01:14:33.596943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f31c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=916000000,duration_sec=1615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:33.597089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:33.597411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:799 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:14:35.593916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:800 started Oct 09 01:14:35.597067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f31e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=917000000,duration_sec=1617,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:35.598759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:35.599098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:800 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:14:37.595417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:801 started Oct 09 01:14:37.597708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f320,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=919000000,duration_sec=1619,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:37.598262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:37.598608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:801 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:14:39.596877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:802 started Oct 09 01:14:39.599208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f322,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=920000000,duration_sec=1621,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:39.599789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:39.600158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:802 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:14:41.597970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:803 started Oct 09 01:14:41.600577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f324,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=921000000,duration_sec=1623,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:41.601182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:41.601527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:803 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:43.599086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:804 started Oct 09 01:14:43.601412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f326,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=922000000,duration_sec=1625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:43.601976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:43.602352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:804 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:14:45.600446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:805 started Oct 09 01:14:45.602961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f328,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=924000000,duration_sec=1627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:45.603519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:45.603927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:805 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:47.601538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:806 started Oct 09 01:14:47.603926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f32a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=925000000,duration_sec=1629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:47.604490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:47.604845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:806 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:14:49.602481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:807 started Oct 09 01:14:49.604883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f32c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=926000000,duration_sec=1631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:49.605453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:49.605809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:807 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:51.603351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:808 started Oct 09 01:14:51.605730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f32e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=927000000,duration_sec=1633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:51.606293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:51.606642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:808 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:14:53.604777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:809 started Oct 09 01:14:53.607414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f330,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=928000000,duration_sec=1635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:53.608010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:53.608364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:809 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:55.606181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:810 started Oct 09 01:14:55.608596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f332,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=929000000,duration_sec=1637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:55.609182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:55.609558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:810 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:14:57.607583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:811 started Oct 09 01:14:57.611305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f334,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=931000000,duration_sec=1639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:57.611901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:57.612259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:811 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 09 01:14:59.608407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:812 started Oct 09 01:14:59.610798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f336,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=932000000,duration_sec=1641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:14:59.611367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:14:59.612260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:812 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:01.609575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:813 started Oct 09 01:15:01.611951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f338,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=933000000,duration_sec=1643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:01.612515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:01.612867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:813 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:15:03.610713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:814 started Oct 09 01:15:03.613641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f33a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=935000000,duration_sec=1645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:03.614216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:03.614570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:814 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:05.611954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:815 started Oct 09 01:15:05.614870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f33c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=936000000,duration_sec=1647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:05.615427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:05.615820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:815 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:07.612912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:816 started Oct 09 01:15:07.615304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f33e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=936000000,duration_sec=1649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:07.615967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:07.616315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:816 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:09.613411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:817 started Oct 09 01:15:09.615763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f340,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=937000000,duration_sec=1651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:09.616354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:09.616705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:817 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:15:11.614149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:818 started Oct 09 01:15:11.616791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f342,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=938000000,duration_sec=1653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:11.617349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:11.617724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:818 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:13.614644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:819 started Oct 09 01:15:13.616977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f344,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=938000000,duration_sec=1655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:13.617536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:13.617891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:819 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:15:15.616090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:820 started Oct 09 01:15:15.618966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f346,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=939000000,duration_sec=1657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:15.619531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:15.619997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:820 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:17.616748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:821 started Oct 09 01:15:17.619070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f348,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=940000000,duration_sec=1659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:17.619649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:17.620007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:821 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:15:19.618118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:822 started Oct 09 01:15:19.620527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f34a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=941000000,duration_sec=1661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:19.621043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:19.621396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:822 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:15:21.618757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:823 started Oct 09 01:15:21.621212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f34c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=942000000,duration_sec=1663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:21.621770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:21.622120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:823 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:23.620065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:824 started Oct 09 01:15:23.622819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f34e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=944000000,duration_sec=1665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:23.623382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:23.623778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:824 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:25.621341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:825 started Oct 09 01:15:25.623800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f350,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=945000000,duration_sec=1667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:25.624357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:25.624703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:825 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:27.622711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:826 started Oct 09 01:15:27.625393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f352,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=946000000,duration_sec=1669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:27.625904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:27.626258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:826 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:29.623343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:827 started Oct 09 01:15:29.625743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f354,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=947000000,duration_sec=1671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:29.626310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:29.626663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:827 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:31.624751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:828 started Oct 09 01:15:31.627051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f356,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=948000000,duration_sec=1673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:31.628165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:31.628555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:828 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:33.626213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:829 started Oct 09 01:15:33.629082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f358,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=949000000,duration_sec=1675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:33.629670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:33.630018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:829 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:35.627291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:830 started Oct 09 01:15:35.629696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f35a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=951000000,duration_sec=1677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:35.630259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:35.630615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:830 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:37.627801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:831 started Oct 09 01:15:37.630820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f35c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=952000000,duration_sec=1679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:37.631381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:37.631768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:831 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:39.628931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:832 started Oct 09 01:15:39.631256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f35e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=952000000,duration_sec=1681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:39.631842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:39.632199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:832 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:15:41.630492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:833 started Oct 09 01:15:41.632792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f360,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=954000000,duration_sec=1683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:41.633349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:41.633725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:833 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 09 01:15:43.631184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:834 started Oct 09 01:15:43.633566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f362,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=955000000,duration_sec=1685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:43.634246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:43.634602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:834 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 09 01:15:45.632343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:835 started Oct 09 01:15:45.634777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x363f364,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=9214758823016176915,duration_nsec=956000000,duration_sec=1687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107274) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 09 01:15:45.635350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: DEBUG neutron.agent.linux.utils [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109034. {{(pid=107274) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 09 01:15:45.635817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107274]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-79529bc1-93fc-4ac6-80cd-cb996683bd31 None None] Agent rpc_loop - iteration:835 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004